DOCUMENT RESUME. 



ED 2*1 7 94 

AUTHOR 
"TITLE 

INSTITUTION 
SPONS AGENCY 

PUB DATE 
CONTRACT 
NOTE ' 



PUB TYPE 



EDRS PRICE 
.DESCRIPTORS 



■ ' GE 038 655 

■ ■ 1 " 

BeyttrsMarom, Ruth; Lichtensteift , Sarah 4 ' 
An Eleigentatfy Approach to Thinking under Uncertainty: 
A Prototype Text* Technical Report 577/ t 
Decision Research, Eugene, OR* 

Army Research Iqst* f;or the Behavioral and -Social 
Sciences, 4 Alexandria, Va* r . 

Oct 82 * 
MDA903-8I-C-0376 

157p*; Translation and adaptation of the Hebrew text 
"Thinking under Uncertainty n by Ruth Beyth-Marom and 
Shlomit Dekel, ^Center for Teaching of ^Humanities and 
Social Sciences, Hebrew University, Jerusalem* 
Translations (170) — Guides - Classroom ttse rf ~ Guides 
(Spr Teachers) .(052) J ' * 

MF01/PC07 Plus Postage* 

Adult Education ;■ Cognitive Processes; *Decxsion 
Making; Decision Making Skills; Learning Activities; 
Management - DeVel'^parent ; Military Personnel; Military 
Training ; *Predictton ; * Probability; *Proble« * 
Solving; ^Sampling; Textbooks 
IDENTIFIERS *Unc*rtainty < 

• \ 

ABSTRACT 

This textbook for teaching reasoning processes and 
decision making under conditions of uncertainty is written at an % , 
introductory level* Based on a translation of a Hebrew book^the text 
is intended for the general training of military and civilian 
personnel required to prdcess, sort, and/or evaluate incomplete, * 
unreliable information* Potential users are Managers) commanders, and 
forecasting specialists* The first section, chapters 1 through 4, 
provides a general frafeework for thinking about uncertainty* Specific 
chapter topics include certainty and uncertainty, defining the , 
uncertain situation, listing and grouping possible answers, and 
defining degrees of belief* The second section, chapters 5 through 7/ 
discusses two tools,, estimation and sampling, frequently used in 
dealing with problems caused, by uncertainty,* The last section, 
chapter!**© through 11, deals specifically with probability 1 
assessment* The'relationShip between »the chances for a single 
observation of a characteristic, the percentage of that 
characteristic in ^a group, and estimation 6f chances in exceptional, 
problems ar^e covered* Two examples are preseiited that are worked out 
using the starting-point^and-ad justment method* Exercises are 
provided within aadh chapter* A list of technical references and an 
oumne of £elate3 topics for further study conclude the text* 
(YLB) " * ■ ' > x 



*********************** 

* Reproductions supplied by EDRS arjp the best that can be ma<Je 

* 1 , from the original document* 
**********************^********************************************** 




Technical R4port-577 



</ 



AN ELEMENTARY APPROACH TO 
THINKING; UNDER UNCERTAINTY: 
;t ,'A PROTOTYPE TEXT- 



Ruth Beyth-Marom and Sarah Liechtenstein. 
DECISION RESEARCH? 



UJ&. DEPARTMENT OF EDUCATION 
NATIONAL INSTITUTE OF EDUCATION 
elWCATlONAt RESOURCES INFORMATION 
W> CENTER <ER*CI 

^Ah» document h« itp*c&>ci>4 n 

r«c*rvtd from in* pflfwr* <k offl*n»tt<»on 

origvuoa? d 

Minor changes havt bs*« m*J# to "nD-rove 

* m*nt do not neeatunry r*pf«en< 9N»ti»J NtE 
ponton or PC*CV 4 




U* S* Army , \ 



Research Institute for the Behavioral and Social Sciences 

r " October 19S2 / 



Approved for public ran a to; distribution unfjptitftjj* 



U. SMARMY RESEARCH INSTITUTE 



FOR THE BEHAVIORAL ANP SOCIAL SC1ENCES 

A field Operating Agency under the Jurisdiction of the 
Deputy Chi*f of ftaff for Personnel 



EDGAR M, JOHNSON 
Techni<jal Director 



L, NE ALE COSBY 
.Colonel, IN 
Commander 1 . 



Research accomplished under contract 
for the Department of the Army 

Perceptronics, Inc. ^ 



1 NOTICES 1 

.* - ' * 

' DISTRIBUTION : Primary distribution of this report hasten mad* by .-Aft I* 
I # Please address correspondence concern Ing * d istr J but Ion of reports to: U*S* 

^ r * Army Research Institute for the Behavioral and* Social Sciences, 'ATTN : 

, PERI-TST, ,500)' Elsenhower Avenue, Alexandr ia, Vfrglnja 22333. 



FINAL DISPOSITION: 



This report' -may be destroyed When It ls v no longer 
needed*;" ^Pleqse bo not return It, to the**u*S* Army Research Institute for 
the Behavioral and Spclal Sciences* * > 

NOTE: >The findings Jji tfrts r epor*t„ a rer not to*be construed' as an official 



Dejyarfment of the Army pos It ) on, un I ass so d#s Ignated by other author I zed 
documents* * 1 " * ' * 3 * 1 ^ 



Unclassified 



sgguriiy cl *sstfic*T»OH or this page (wh™ o#f* £nr*r*<o 



■ . ' ' REPORT DQCUMENTATION PAGE 


♦ READ TWSTRUCTIONS 
BEFORE COMPbETINCr FORH 


1- REPOflT-tfUMBCR v ^ 2, JGOVT ACCESSION HO^ 
" ■ i * * a 

"Technical Report 577 


3. ReC|P|EHT-S CATALOG NUMBER * 


4, TITLE f*nrf JufrfUUj * 1 ' */ 

^ AN ELEMENTARY APPROACH TO THINKING UNDEK ^* 
UHCERTAINTt : A "PROTOTYPE /TEST 

■ 4 ■ C " 

• 'J : * 


s + type "of report 4 period coverco 
* Technical Report 

* t * r- * 1 * 


«.^P|^CO^MtHG ORG. flgPORT NUMBER 


^ AUTHO«OJ - * f ' + ■ 

J 1 *■ / 

," Ruth Seyth-Marom 

Sarah Lichtenstein^ _ • * a - 


t\ CONTRACT OR GftAlfT HM&£ft{*) 

MDA903-81t-C-0376^ 


9.. PERFORMING ORG ANIMATION NAME AHO ADQRESS * 

Decision Research.. 

A Branch" of, Perceptronics , * 
1201 Oak Street - r . * 
Eugene, Oregon- 97401 * 


•10. PROGRAM ELEMENT. PROIGCT, TASK 

AREA ft *OR* UNIT NUMSCRS 
1 ■ * 

*2Ql6li02B74F 
4 ' 


,11- CONTROLLING OFFICE J* AMC AHQ ADDRESS ' 

US- Army Research institute for £he Behavioral 
c/v and„Sociab Sciences. fEkl-5F ■ | 

Alexandria/ VA 22333 ■ " * 1 * 


12. REPORT 1 0**E . 

October 1982 " 


ii* number of pages k 
154 ' r 


14. MONITORING AGENCY H AHE ft ADORESSfJf dtttttmt frem C»^lrttf Of He*; 

• \ . ' !' 


IS. SECURITY CLASS, fi^thi* t+pett) 

\ Unclassified 


is* + oecL assificati<jh/dowhgraoih<j 


is. otSTRtaoTion statement {*/ rM* R*po*t) 
Approved for public release; dlstril 

'-■■'■A . y •/ 

.' ■ " ' *. i 


uJtion unlimited. 


17 > DISTRIBUTION STATEMENT fat th* •bttt*ct mt*t*d fni&feck 20, If t#tt*f<*\t from Rwport) 

^ . ; ^ * • 

* F * 

* / . . * 

■..,(.. •* , - 


1ft. SUPPLEMENTARY NOTES f J * t ■ 

* 1 


14. K£Y WORDS fConf/rtu* on *f<f* /^rt *e * * **/7 + *nef td*nttfy by bt*<& t%utnb*t) * < 

Decision Making " # Tefct "Materials a 

Information Processing *-'/'*.'' • f 
Training * . ' 

Uncertainty / / , ; " * • 


20. ABSTRACT (Cootlmt* <*T *M» Up md f<T*r>tyjy by bivck mtmb+r) 

This technical report is a prototype elementary textbook for teaching 
reasoning processes and decision jnaklxig under conditions of uncertainty* It is 
written at arv introductory lev4l ^nd designed to be usable for nontechnical 
personnel* Tfte text Is basetj/ 00 a* translation of a Hebrew iook and adapted 
for the American student audience. Tne original material is based on the 
s^ud> of irftultivfe'thought processes and 'capitalizes on information about . \ 
cognitive biases that typically lead to faulty decisions and judgments, ' / 
Methods are outlined for processing partial unreliable, information in the p 



ERIC 



473 eo/pdM of i poy 0^ rs obsolete 



. . UNCLASSIFIED' - 1 

sect/hiTY cu«^!f iCATtow or.Tttu f *oe t?**^ 



UNCLASSIFIED . j. 

SECURITY CLARIFICATION O* TNI* P&Qgflff>*n Dtl* Ent+t+f). t 



fdlltiwing categories: (l)^when chodsing the iposr Jfijcehr. among a* set' of * - 
possible solutions; (2) when estimatinfe/a numerical value as the solutiorf.in a 
quantitatiW problem; (3) when, assessing the probabilit.^of occurrence of an 
event; and (4) when estimating the chances of an evint lp exceptional' problems, 
Practice problems are provided at. the end of most chapters! In addition, a t 
~Asi of technical references ,and"an outline of related "topics for "further 
tu'dy are presented at the conclusion of the'text. Military command, control, 
id intelligence personnel should £j.ncfc;this t£xt applicable and easily adapted 
&r the training of human information" processing antf. decision making* * 



j 



r + 



ERLC 



UNCLASSIFIED 



SICUniTY CLAUDICATION O* TMI1 PAOE(*?l*n D*lf fnturtd) 



5 



ihrite^l 



Technical Report 5^7 - -f '.-Ai 



■i r " " x 1 



AN ELEMENTARY *' APPRQA(jft x TO 
THINKING UNDER UNCERTAINTY: 
* A PROTOTYPE TEXT ' 



v * ■ . 7, 



■ ' ' * s ; «* ■ ' . , ' ^ - y * 

. ' * - ■ ; .-■ X ■' 

'■ - ' >■ r). V • 

, ' , ' Ruth Beyth-Marom and I Sarah Lfchtenstein . i,/, 

' ' ' pECISION RESEARCH" * £ / / ( \ 



Submitted by: 
/-Robert M. Sasmor 

DIRECTOR. BASIC RESEARCH \ lf 



7- -.i, * 



X 



V - ^ 

■ ? ' / Approved^by: \. . "* , c L 

EjLdgar M- Johnson - \ z . 
' ! TECHNICAL DIRECfbR V " 



^ r U& ARMY RESEAR(JH INSTITUTE FOR* THE BEHAVIORAL AND SOCIAL SCIENCES 

\'.'".' '•'■*-' ' '" "■ 



r 



>' r / "* 506l Eisenhower Avenue, Alexandria, Virginia 22333 1 ^ ' ^ 

• - **• * * \ ] . t , Office, Deputy Chief ofrStaff far Persifonel 

. ' Department of the Army 



^ ■ \ " V - . i ' Octotfar 1982 



f 



; ^tmy Project .Rjjnlw ^ A; 'I Ba * lc Research 



rf ^ . ^ * Approved for puWfc rMtm: distribution unlj^ittd. 



ERIC 



• ARi .Research Reports gnd-Technicar Reports are intended for sponsors of 
fl&D tasks and for other resyerch and^military agencies/ Aijy findings ready 

^lor implementation sit t£ie time of publication are' presented in th£ last part 
ofjhe Brief. Upon completion of a major phase of the task, formal recom-. 
mendatiote for .official action normally are conveyed to app^priate mitttary 
agencies by briefing or Disposition Form. * * \ 



M 



, V 

* 



r 



c. 



iv v jr. • 



FOREWORD 




the Human Factors Technical Area is concerned with the demands 6f the . 
future battlefields for*' increased us&r/svstjn capacity to acquire, transmit, 
process^ disseminate, and utilize information.. Research is focused on user/ 
sy^tenTlnterf ace .problems and interactions within command, control; and in- 
telligence centers and is concerned with suck areas as tactical, symbology, 
user-oriented systems, information processing and management, and staff 
operations aad procedures^ .as well as sensor systems integration .and 

.utilisation* * * 

\ ' - * , 

One area of special interest is the development, of procedures to support 
and enhance the decision-making process within command, control, -and intel- 
ligence centers* The current xeghnifial report contains a prototype introduc- 
tory textbook for structuring probabilistic thinking and decision making 
under conditions .of uncertainty*. Based on the study of intuitive reasoning 
processes and cognitive biases, it presents simple tools which can be used 
to solve problems typically encountered in everyday situations* Techniques 
for choosing the most likely amoag a set or possible answers, estimating a 
.numerical value as the solution to#a quantitative problem, and assessing the 
probability of occurrence of an event are outlined as well as illustrated with 
numerous examples* References and^reuggestitihs for further study of this topic 
are presented at the conclusion of the text,^ 

Research in decision aiding is conducted as an %n-house effort with ad- 
ditional support from contracting organizations that are selected for their 
unique contributions to this, area. This effort is 'responsive to the, require- 
ments of Army Project 2Q161102B74P* 




Technical Director 



Thinking jmder Uncertainty 
(in Hebrew) 

Ruth Beyth-Marom 
* and 
Shlymit Dekel 



\ 
) 



Copyright held by the state of Israel 
This translation/adaptation included in this report by permission 

English translation and adaptation by 
■ - ,Ruth Beyttv41aroja y 

Sarah Liechtenstein * ^* 

— \ 

* t * 

and \ 

^ **" \ Benny M$ro$ J 

*■ 

V / . . < << 

■ . . . ■ \ / . 



The Hebrew te#t was developed" an<f ^prepared within the /framework 
of the Center for' Teaching of Humanirt^es and SociaJ. Sciences of tfte 
School 6f Education, the Hebrew Univecsity^ Jerusalem; in cooperation 
with the Curriculum Qen'ter, tHc^Unistry of Education ai^ Culture, 
'Israel, The rights of . tte Hebre^versioti are reserved to the state 
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AH. ELEMENTARY, APPROACH 'TO THINKING UNDER UNCERTAINTY: ' A PROTOTYPE, TEXT 
EXECUTIVE SUMMARY 



Requirement ; 



To develop a prototype introductory textbook fpr use by .persons regard- 
less of previous formal training, to improve their probabilistic thinking 
skills, specifically dealing with the topic of decision making under condi- 
tions of uncertainty* * * * 

'+ 

Approach; ^ , A ■ ^ 

A Hebrew textbook designed to improve student analytical and thinking 
skills through an understanding jot the concept of "uncertainty" >nd the use * 
of specific heuristic procedures Wbs translated into English, and adapted f jgr 
tlhe £±erican student reader* * t 

The development of the original text was based on the study of intuitive 
reasoning processes and the identification of thinking and decision -making 
biases that typically lead to faulty judgments and decisions* Emphasis was 
placed on the identification of easy-t07iinderstand procedures for understand-" 
ing uncertainty and circumventing common ^th inking errors* Examples appropriate 
for pfte American student were, developed* * 

■ — * * 

Productt J ' ^ 

t This report contains a prototype textbook. whic|* introduces the concepts 
of Uncertainty and probability and expands on some tools for reducing errors 
and improving thinking skills when' processing partial probabilistic informa- 
tion* Concepts, and techniques are exemplified throughout with numerous exam- 
ples* Approaches 'for developing skills in four major areas are presented* 
Cl) When the goal is to- choose the most^likely among a set of possible / 
solutions ?o a problem* a framework is given for formalizing the question, 
eliciting a list of plausible answers, and defining the degree of confidence 
in each* (2) To arrivetat^a numerical value or range of values in a quantt- . 
tative problem, the techniques of estimation based on populations and samples 
are discussed* (3J To determine the probability of xoccurrence of a given 
event and extrapolate from group percentages to individual chances t ' the 

<^chniques of probability assessment are demons trated* v (4) In addition, 
special attention is given to" the issue 9f estimating chandes in exceptional 
problems where an overwhelming amount of relevant information is available* 
Practice problems to extend understanding .are provided at the end o{ most 
chapters** A list of technical references for background reading and an out- 
line, of related topics for further study are also indicated* 
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Utilisation: 

^ The prQtot^pe text^outllnes simple, well-founded techniques for the 
human processing of Information which require only rudimentary mathematics 
and can be used In day^to-^ay circumstances to make better decisions* The 
basic text material can be easily adapted to specific application -areas by 
replacing the existing examples of ones relevant to the new topic area* This 
text will be useful In* the general training of both military and civilian 
personnel wfio'are required to process^ sort ^ and/<*r evaluate Incomplete, un- 
reliable Information; for example, potential users are managers, commanders 
at any echelon, and forecasting specialists. Jn addition, specific high- 
payoff military application areas Include training In decision making and. 
Information processing in the fields of coffland^ control, and Intelligence* 
" ' t ' 
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\ . J \ ' " PREFACE TO THE HEBREW TEXT . , - 

* "The implementation of scientific -ideas into the educational system 1 ' was 
tl^jSjpe of a lecture givea by Daniel Kahneman to a group of graduate students 
participating -in a seminar organized by Seymour* Fox, then head of the School * 
-ef Education at* the, Hebrew University, Jetnis^lem, Israel* In that lecture 
the, first e*e$£s of the present book were planted. 

Dr* Kahneman studies people's reasoning processes. He looks for correct 
vand mistaken intuitiWi and* suggests ways t$ overcome blades 'in the thinking, 
processes taking place under conditions of uncertainty. 

Aa* a researcher aiyi educator, Jfrt* Fox is interested in curriculum devel- 
.opment>nd the, incorporation of scientific (educational and psychological) . \ 
ideas infp school curricula. 

.-. • v 

, These, two people ^encouraged the development of a curriculum devoted 
solely to A inking «undter uucett^inty, one product of whict^ is this book. 

Many* others contributed to this b6ok: ' J * * 

Ruth Go^ffeo arid Moshe Shaked went over the text many times, editing and 

adding* trying it in their -classes , and developing most of the exercises. 

' ' ■* \ 

j ♦ 

* * \ 
Baruch Fiachhof f ^nd Sarah lichtenstein, two American psychologists who 

have been studying thinking processes forbears, reviewed the text and made 

suggestions . 

Miriam Basok and Efrat Balberg were helpful in the first stages of 

planning and writing. . * 

i Finally, we leaned mwfr-'from a number of junior high school teachers 
who had the courag^ to teach "thinking under uncertainty" long before the 
textbook was>eady: Yossi Leshem, JuditK Miller, Aliza Paer, Tamar Kahn, and 
".Lea Shatil.' 

A . 
We deeply thank all these people* Without their help, the raw ideas 
woul<JMiave neye^ developed itifb a textbook. * +\ - 

4 * 
1 * * 

• " INTRODUCTION * 

• ¥ 

When you start reading this book, you do not know much about it. What 
is its content? Will ypu understand it? Will-you enjoy ir? AEout all these 
questions, you 4 experience feelings of uncertainty. This is just one example 
of the -uncertainties that accompany nearly every step) of our lives. 

* J/e feel uncertain abou£ the small events in our lives; 



W^en will the bus arrive? 



• Ttfill it fain tomorrow? 

• Can I stick to ray/diet this week? 



And' we -also, feel uncertain "abqut mudh more major problems: 



• t Can I ,g£t a good job? 

* . ^ * C > ■ * 

• v Should I marry this person? 

• Will I survive the s^gical operation? 

Businesses and other groups oi people also face uncertainty; 

• Will this new product sell? " 

• Will our Research be funded? v 

• Is ^the defendant guilty as charged? 

^Even the latgest organizations In otfr society experience uncertainty: 

• Will ^jcax cut fuel Inflation? ^ 

• Will a hard st-ariSe on defense decrease the chances of war? 

t 

.But uncertainty does, nat prevent us Jrom making decisions* We must ^ 
decide- whether or not to carry an umbrella before, we know for si\re what the 
weather will be* Legislators must Vote yes or no on a tax-cut bill even If 
they are not certain of Its .effects* Nearly every step we take/ as private 
citizens, as groups ,. or as a whoW society, Is the result of a decision made 
undef uncertainty*. c ' 

lousands of years ago, ^n the primitive world, people tried to solve un- 
certainty by consulting 'prophets* The prophets exchanged uncertainty for cer- 
tainty^ they told people what would happen lif the future as If it were certain. 
Even totfay, people go to .Astrologers , look at horoscopes, and take other 
actions chat give the feeling of diminishing or even eliminating uncertainty* 
Some 'people believe that In such ways one can see what will happen in the 
future, 

*Most people do not try to eliminate all uncertainty but live with it -with 
the help or, their, intuition * Intuition Is a kind of sensation or Inner feel- 
ing that guides us and shows us how to act* It is a personal feeling, a per- 
sonal thinkibg tool that we use without asking how it really functions* This 
feeling Is very different from person to person* It Is a result of life ex- 
perience and actions *we have taken In the past* , , 



* Re sea rcbei 
live witji r or 



have realized how Important it is to look at the way people * 
spite of, uncertainty* These researchers have tried to find 



out how our lAtu 
¥he results of t 
and personal thin; 
different people w 
'elderlyj, and lay p 



s work, how people think and act in uncertain situations* 
research Indicate that although intuition Is a private 
th&e are* strong commonalities among the Intuitions of 

they think under uncertainty* Young people, like the 
pie, like professionals, use similar thinking tools* When 
those thinking processes ar^ compared to the best-known methods for treating 
uncertainty, metfiods\ taken from statistics, probability,^ an<! decision theory, 
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the researchers found that our intuitive 3 thinking" processes are much simpler** 
While these simpler methods are often satisfactory, 'they can sometimes lead * 
us into errors* * . ( 

Susan has just been admitted to the hospital in labor. The doctor on' «< 
duty tells Sus£n that the last six babies bo nu there W^re girls. T "In tfiat, * 
^case, M SySan responded, "I figure I'll have a boy." . ■ ^ 

\ Many people would answer as Susan /did, soma of them w£th a smile, others 
with great seriousness* In such situations, bur intuition, tells , us that * 
things "balance out," so tha£ a series of consecutive birtks of girls will 
make a boy more likely for the next^jbirth* Btlt here our intuition leads us 
astray. More. careful thought makes us realize that the gender of those otRer 
s±x r bab;Les cannot possibly influence or change the gender of Susan's' baby. 
This 'is just one' example bf, a bias in. our intuitions that can> in other cir- 
cumstance, have an enormous influence on human behavior. 

» 4 

this book presents an introduction to uncertainty. Based on research 
abtfut'people's intuitions, it describes how people usually thiitk about uncer- 
tainty .andtjfcufE errors these intuitive modes of thought can produce. It.de- 
scribes sdmeT better ways to think-about uncertainty ■ ^, 

*fae are not trying to change your intuitions. Indeed, even* the intuitions 
of researchers who have been working in this domain for many years have not 
changed, drastically . Instead, our goals are to alert you to situations in 
which intuition can lead you astray and to provide you with new w^ys of think- 
ing clearly in those situations. < » 

We have included some practice exercises at the end of most chapters. t 
No answers are provided, £ut We 'hope you will try the exercises as a way of 
deepening your understanding of the topicfc* your real learning will come, 
however, when you apply the techniques and ways of thinking described here to^ 
your own' life and to the uncertainties you face every day- 

In this book we do not try to'be prophets or astrologers. We cannot 
convert uncertainty into certainty, and we cannot provide absolute t solutions . 
The techiiicfues we recommend do not guarantee that you will achieve desired 
outcomes in uncertain situations. But Using these techniques should produce 
better outcomes more often than not using them. 



This book is divided into three sections , The first section, chapters 
-4, provides a general framework for thinking about uncertainty. The second 
section, chapters 5-7, discusses some tools that are frequently used in deal- 
ing with problems under uncertainty. The last section, chapters 8-11, deals 
specifically with probability assessment. 
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SECTtON.I-: 'A'GENERAL FRAMEWORK > . ' ■ 

"f * , ■ ' '■ , . , * - ' 

CHAPTER,;! • [■ "/ . . -V ' V;'- X ' ' 

■ \ *' *>- ' ' * - ■ . 5 

'•■ ■ ' ' ' '* . " • . ■ — . ^ ^ ' _ *"* . 

'V CERTAINTY AND UNCERTAINTY 

Feelings, of "XRrtgjftty and TfaceTtathty , # / , 

~. * "i % - t * v /. 

We'oftpri Bear, as /part oT the answer ttt a question, phrases. like, n I f m 
*sure that*,,'," "I've no doubt that*** ; " or "I'm positive that****" People' 
using these phrases really believe that they have .the 'answer to tke'question 
and*rei*l no doubt of its truthfulness* • , .* ^ 

• 4 Question; What are you doing righ£tnow? 

/ ' - 

Answer: I am reading* 

• * * 
.Nobody would ask, "Are you sure about that?" 

+* Question: David, what gender are you? 

\ Answer; I'm sure I'm a ^rfan* , J 

• Question; Elizabeth, what will you d£ this afternoon? 

* * r 

Answep: Ncf doubt about i^f, Vllgojffo the movies. 

• Question: John/ whose picture is that? ' 
Answer; I*m confident that's my sister* ♦ 

• Question: D&n/what kind of sandwich did you eat for lunch today? 

Answer: I V&qw for certain I had a cheese sandwich* x 

In all these examples, the question asked relates to a fact or to an 
event in the past, present, or future- The person .answering feels very cer- 
tain, wry confident, witlj no doubt at all* David is sure, Elizabeth has rfo 
doubt, John is gonf ident » §iid Dan knora for certain * 

* - ; : j 



We experience certainty about a specific question when we 
>have a feeling of fcoinplete belief or complete confidence iji a 
singte' answer tothe question* 



Certainty feelings originate from th£ confidence we have in our knowledge 
and in. the experiences we have accumulated through the ydars (Dan has seen and 
tasted cheese many tia©£, and he kpows how it looks and how it tastes} and in 
die confidence we have,in the functioning of our senses (Dan relied on his 
eyesight and taste) - 



This confidence may sometimes fail us* Elizabeth, who is so sure of her 
m plans^for the afternoon , ^nay find such a long line at the theater that she has 
no chance^ to get in* 'She just did not think about such a possibility 
beforehand* - , 

Knowledge aryl experience generally fail us when we face radically new 
developments. Until the lSth . century, people were, certain that the sun re- 
wived irouittl the earth. ,But some of those who^heard of Copernicus 1 new 

ideas about planetary motion replaced their previous 'Certainty with doubt** 

* / *■ 

\ ^ 

\ Our senses can also fail us* Have you ever sat in a standing train 
While. another train began to move? Sometimes you get^ the strong sensation 
that! it is your own train that is moving* Only aftet the moving train has 
passed 4 your window* do you realize that your train is still standing in the 
,same place* Novice mountain climbers,* often misjudge the summit, believing 
they are on the final approach when in fact they are still far away* As with 
our experiences, we cannot always rely on our senses, They can. fall us in 
many situations* ■ * * ^ 

In spite of 'these occasional failures, we do rely on our senses and the 
knowledge and experience that we have accumulated because, most .of the tine, 
they work* Moreover, if we had to make the effort to think abcfut each step, 
we take each time we take it, we would not be able to function at all* Should 
we stop eating just because there is a small chabCe that the food in front of 
us is not the food we think it is? We ptefer assuming that our knowledge and 
our senses are good enough* j- 

In contrast to the feelings of certainty we experience with some ques- 
tions, there are other questions that lead us to feel uncertain* 

* * 

• Will it rain next Saturday? , 

* * 

• Are there intelligent creatures in outer space? 

• Will the strike be settled within a week? 

f r 

' • Where have I met this person before? 



4 

• Bow many traffip accidents were there last year? 



, , - T 

Concerning such questions, some of us, and sometimes all or us, feel un- x 
certainty. To some questions, we cannot offer even one plausible answer. Who 
ruled Italy in 1563? Most people will be unable to suggest even one possible 
answer^'" 

. -V 

For other questions, many answers come to mind; some seem more suitable 
than, others, but we do not feel completely confident about any one answer. 
How many members are there -in the U.S. House of Representatives? X think it 
may be 435, but it might be 235, or 436, etc. My confidence is spread over a 
large number of possible answers. 
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Consider an archeologist who/is diggings site in the Great I^alns of * 
North America and \fi\o wants to determine, the date at which people lived at 
the site. While digging, she found § leaf-shaped flitit implement that she* 
will use as a clue for deciding about the' date of the' site* ^She knows that 
such flints aire prehistoric* Fui**eriiK>re, its shape rules out some periods 
in prehistory but leaves three posf^rtlities: (1) The present implement is 
most typical of the "Clovis'\type o^rojectile point, which was" used between 
9000 and 8000 B,C; therefore* it'is highly, probable that the site dates to 
that period. (2) However, ihe point has some characteristics of the "Folsom" 
type, which was Hi use late*, between -8000 and 7000 B.C,£ thus, it may be from 
that period* Moreover, such prehistoric points are highly valued by collect 
tiirs, and a ready market for modern fakes has developed* This point might be 
a fake. (» Thus* perhaps the site is modem* , ^* 

The archeologist is sure that these three answers cover .the range of 
possibilities. Other possibilities ffi not seem plausible* She has three 
possible answers to the question, S#e feels a partial belief . in each of the 
\ three answers* This partial belief is expressed in the words rt highly provable 
)"may be, rr and "perhaps/' At that moment, there is no one answer toward which 
fshe feels complete confidence. Therefore, we say that the arcfieologis t fee^s 
uncertain about the question, "How old is the site?" .** O 

To summarize: We experience uncertainty concerning a specific question' 
when we have a partial belief in each of a number of possible answers to the 
question, ^ 

■ But what about when we cannot think <if even one plausible answer to a 
question, as in the example of the ruler of Italy in 1563? Although we do 
not have a partial belief in a number of answers (because we cannot think of 
any answers) t we do feel uncertainty. If someone were to present us with a 
number of possible answers, we would not feel complete confidence in any of 
them* In order to include this las* case, in which we cannot think of even 
one answer, in the def£niti!on of uncertainty, we define the feeling of uncer- 
tainty negatively: 



We experience uncertainty about a specific question when we 
cannot give a single answer with complete confidence. 



Exercises 



1* Sometimes, In hindsight, we find out that our uncertainty feelings 
were not justified* Think about ways in which one's certain^ feelings could 
be unjustified for each of the following situations: 

** I attended a concert yesterday* * 1 

* I have been here before* * > 

* The store I am looking for is right around the cornet, * 

* My watch indicates that it is 8 o'clock* 
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• It is now 8:00 p*m* 



• I am standing in front of my house. 



write a letter after the guests leave. ' 

1 ■ A- ♦ * 

2* Think of at least three times when you were sut£ about something 
but turned out to be wrong* y*- 1 % V \ 

^ Characteristic^ of Uncertainty Feelings ; , 

Pergonal and General Urjbertalnty . There are some questions for which we 
feel that uncertataty is currently unevoitiable. These arer questions toward 



which we feel that, nobody now know9>the right answer*; * 

• t Is there any sort pf life on other stars? 

* Is there a monster in Loch Ness in Scotland? "^^v ^ J 



I am about to toss a coin. Will it come up heads .or .tails? 

r 1 ji 

, ft" 

• How did Schubert intend to finishhi^ "Unfinished Symphony? 



For some of these questions, wS expect that a certain answer willfbe^, 

known in the future* As soon as I toss the coin, I will know whether i't^Jpme 

up heads or tails* Other questions may be unresolved forever* Since Schubert 

died before he finished his last symphony (and left .no notes), we wiU;n4ver * 

know his intentions for it, * 

i * 

In contrast to questions about which uncertainty feelings are unavoid- 
able, there are questions that, in principle, somebody can answer with cer- 
tainty* , Ift which hand am I hiding a coin? You feel uncertainty, but I da nbt* 
I am not sure how many Representatives there are in Congress, but I recognize * 
that other people know th^ answer with certainty* ta 1 

4- * * ; " 



fahen 3 person feels that, in principle, there is now no certain 
answer to a question, then that person feels general uncertainty^ 

When a perstfn feels uncertainty concerning the question but 
realizes that, in principle, one could feel cir£pr£3ty, that person 
♦feels personal uncertainty * ' ^ 



Sometimes weytfEay be more comfortable with general uncertainty, because 
we cannot blame our own ignorance* On the other hand, with perjpnal 

uncertainty we have the hope thfct we can resolve tfte uncertainty by consult- 
ing a' more knowledgeable source. J ' * 



\ 
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Amounts of Uncertainty , Paul* was" 1 asked, '"What is, the longest xiver in 
the United States?" tie answered Hrithjcomp let e confidence, "The Mississippi," 1 
Next he was a^ked, "What' is the longest rLyer in the world?" This time, he 
felt uncertain. He was then given, a hint:' The answer is one of the four * 
rivers:* Mississippi, Yangtze, Amazon, 6-t Kile-2 f^ t u ^opw consider four 
possible states of mind Paul might be, in after ££ceiving tne hint, 

\ •* 1- VapL thinks 4ll the answers are equally likely, / 

Now that Paul sees the fous possibilities, he ^remembers reading about 
Egygt not long ago; the article stated that the Kile is the longest river in 
the world/ r 

s t * * * \ * ♦ * ■ 

Those two situations &re e^t^en^e in l;he , sense, that the first one tepre- 
k senr£s maximum uncertainly (every possibility is seen as equally likely) and 
the secoryl represents certainty,- Between those two situations there ,are many 
intermediate situations, and, each^reflects different amounts of Uncertainty, 

3, Paul decides that the Yangtze is ^ertaintly not the right answer, but 
among the three- remaining (Mississippi, Amazon, and Kile), he has nd prefer- 
ence. In this case, he feels less uncertainty than in the first situation, 

in which he-had no preference among four answets, ^ 

4, Paul thinks the answer, is the Amazon, but he is not; certath about 
it. He judges the ^nstfers Mississippi and Kile as equally likely, but not as 
likely as the Amazon-* He is sujre that the Yangtze is wrong, <. 

We can nqw order the four situations according to the amount of Paul's 
uncertainty^Ji^ is most uncertain in Situation 1, because bfe feels no 
preferences among the four answers; The next^most uncertain situation is 3; 
he feels, no preferences among three of the answers, Paul also reduced the 
set of possible answers to three in Situation 4, but here he feels that one 
is more likely than the' other two* This uneven distribution of confidence ^ 
in 4 makes 4 less uncertain than 3, where he thought all three were ^qually £ " 
likely,' Gase 2, of course, is the least ascertain; Paul feels no uncertainty 
at; all, , / , . : 1 * 

^ The amount of uncertainty depends on two factors: the number of possible 
answers one can give and the strength of preference one has for each answer' 
relative to the others. 



1 * - ' ' . 

By "the Mississippi, we mean the entire river system* that includes the h 
'Missljfeippi, the Missouri, and the Red Rock, 

Mississippi: 3,710 miles; Yangtze: 3,400 miles; Amazon: 4,000 miles; 0 
Kile: A, 145 miles. 



23 



'"1- If all possible answer^ seem equally likely, then the 
more possible answers there are, the more uncertainty we feel* ^ + 

^ t\ When there are a fixed number of possible answers, the 
amount of uncertainty depends on th^ ^jjread of confidence across 
the possible*'answers * We feel most uncertainty when all answers 
are equally likely- As the spread of confidence- across the set of 
" answers .becomes "less uniform, we feel less uncertainty* At the ex- 
treme, When we are completely confident in one answer, our uncer- 
tainty *is eliminated* ^ . ' * 



un 



V'The first rule above may be exemplified by dMparing one's feelings of 
uncertainty just before rolling a fair die and justSbefore t*6ssing a coin* - 
There is more uncertainty with the die than with tfieVoin because fhe dig*; 
has six possible outcomes while the coin has" only two* 1 

The second rule above may be exemplified by comparing one's feelings of 
uncertainty about the roll of a fair' die with the roll of a shaved die, one 
on which *a six appears more often than any of the *oth£r sides* There 1 is more 
uncertainty with the fair die because ^11 sides are equally likely to be 

rolled* ^ 

* 

* t We are not speaking about some abstijac£ notion of "objective uncertainty, 
that exists as a^characteristic u out thefe" in the world* Rather, we are 
"speaking about subjective feelings, bejief^, -or sensations* Those feelings 
are naturally very personal and depeSd on experience, knowledge, and other 
individual charSCTgtfistics* One can feel uncertain about who invented the 
telescope, f eelingpftAat it was either Kepler or Galileo* One's feelings of 
uncertainty wiljL increase if the names Copernicus and Newton, as plausible 
additional answers, come to mind*' ^f^* 

Whether one is dealing with general uncertainty or personal uncertainty, 
the amount of uncertainty may be different from person to person* Two people 
may experience different degrees of uncertainty because they have different 
numbers of possible answers to the same question (as with the question about 
the invention of the telescope atfove) or because they have different distribu- 
tions of uncertainty across the same number of possible answers* Do flying % 
saucers 'exist? People*dif fer in their beliefs about this; they differ in 
the amount of confidence they p\ac*e on each of the two possible answers, yes 

and no, and ttws in their overall uncertainty* 

■ ■> 

Changes in Amount of Uncertainty * Feelings of uncertainty are not^ieces- 
sarily constant* Sometimes the amount of uncertainty changes; one feels more 
uncertain on less uncertain because of additional information about the ques- 
tion* More information can change*the amount of uncertainty either because 
the new information adds to or diminishes the number of possible answers or 
because it changes the relative amount of confidence that one attaches to 
each of the possible answers* Consider the following example; 

1* Susan has just finished reading a murder mystery and knows that.X is 
the murderer* * 
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?* Susan then gives the book to H#iry* On the first ,page, there is a 
list of the namea of all the characterjfin the book, one ,of whom is the mur- 
derer* Henry has no idea who tti&t rifght be because he has j&tf^ read the book 
yet* Therefore, he considers all'of them equally likely* _ * ^' 

*3* Henry then reads the first 100 pages* He*now believes with near 
certainty that*X is/the murderer* f * \ * 

4* James also readp the f^rst 100 pages of the ,book. He also s^pects, 
X, but he is.less sure aBout it* He is less confident than John Uec^use he 
thinks, thpt Y might als6 be -the murderer, , - ' / * ' * 

' x ' 

5* Henry then ££ads all but the last six pages of the book* He still j 
thinks*X could be the murderer, but he is now less certain than he'was afteij 
reading only the first 100 pages* Because the* author has presented so many } 
conflicting clues, h.e now feels that except for the murdered person (it was ( a 
murder and not a suicide), everyone of the people'mentioned at the beginning 
of Xhe book might be the murderer* — * 

This example sh6ws that different people can feel different amounts ot 
uncertainty about a .single question sdch as "Who is, the murderer?' 1 

h * 

1, Comparing 1 with 2 (Susan has read it and Henry has not), w e see 

that Susan knows for sure* who the murderer is but Henry has no idea, He 
feels uncertain about the question* . >\ 

7 

2* Adding information (by reading part of theybook) may decrease un~ 
certainty o^ie feels (compare 2 with 3), increase .uncertainly (compare 3 , ' 
with 5) , or not change it at all, (compare 2 with 5)* One can reach the same 
amount of uncertainty in one case because of ignorance (Example 2;"lHeftry 
has *not read the book at all) and in another case because of a lot of Incon- 
sistent information (Example 5: Henry has nearly finished the book)* 

3* The same data can* influence different people differently. ^ Compare 
James in 4 with Henry in 3* They feel di/ferent amounts of confidence in 
the answer', ^"X is the murderer, 1 * although they have the same information* 



Exercises 



r 

1* For each question, *do you think the uncertainty is general, or 
personal? , i * - * 

r. 

• Hotf many microbes are there in the world? : iy 

• * Ij^he number, 247,71^ divisible by 71 * 

• If I bought a lottery ticket yesterday, would I have won 

\ ! 
' • tfhich athlete win the race? 



' ( * What is the age of the earth?" r 

• How much money does George have in his pocket? 

■ 

•2. Tfcink of three examples of questions for which you have^persona^. 
feelings of uncertainty and three questions fbr wfiich you have general feel- 
ings>-of uncertainty* 

3* Each of the following questions has two possible answeys^ yes and no* 
or "each question* -(a) i think of a p # iece of information that, witl decrease your 
uncertainty >y making you more sure that ydu know the right aiiiwer; then , 



Cb) think of another piece of Information *th^t tfill Increase your uncertainty 
way contradict the information you gave in (a)* . V 



lat \ 

relative to the uncertainty you felt after (* * Thi$ informat top: will income 



* Will tomorrow be a nice* day? 

* Is milk good for health? t ' 

* Sfould children be taught to read before entering first grade? 

* Will the Republicans win the next election? 

* Is my car about to break down? 

A * 

T^Will Nancy remember to pick me up at 5:00 p*m*? 
* ** 

* Will the al^nn go off t^motrow morning?^ 

* Will ^T^iinpress tfre interviewer during my job interview? * 




Uncertainty and Decisionmaking - *. J , 

v In everyday situations^ the uncertainty we f + eel usually does not keep us 
from acting* Even the most cautious of us do not. delay action until'feeling 
certain* Xf one always waited until one felt certain* one would rarely tak6" 
any action at all* 

* It is not certain that I'll^reach work without an accident on^th^ way. 

* I can f t b& certain that when I turn on the hot water I won f t get a 
"~ cold shower > 

y < ** ' 

* # I can f t evfen be completely certain when I go to J>ed at night that the 

tbed won f| t collapse * * * 

When such possibilities ^re raised* we are suddenly conscious that all 
. 'those situations are t to some extent* uncertain* iftrfr the chance of something 
going wrong is so small that we are willing to take the chance ancl proceed to 
drive to work* turn on the shower* or climb *into bed* " K , ■ 
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Even when we are not willing, to disregard the less "probable .outcomes, 
we do not always avoid action* Sometimes we can^act and^ake suitable safety " 
steps* J , : ^ ^ i 

• I'll take an umbrella on a cloudy day because I don't want to r get wet J 
if it rains* ' 

; • JfrMy friends s£id that they will" try to visit me tonight* I'm chilling % 
a bottl^&fL : tjfi*ne, although I knpw that they prbBably won't come* ^ 

— fn contrast to these examples in which we act because the uncertainty ia 
small py the safety steps are. easy, (here are situations in which uncertainty 
looms large* Still ye must take some action* - 

^ ' ^ ft 

\ • How much food should I prepare for the party? t ^ 

" ' - " 4 - 
* * • What job shall I accept? » 

With decisions that are important to us, wa act, but only after careful 
consideration and' oftei? while still very much in doubt* * ^ 

Finally, remember that not making a decision is itself a kind of decision; 
not taking an action is a kind of 'action* 

.Shall I go^to. a movie tonight? I fiave read conflicting reviews of the 

film and feel uncertain about whether I'll like It* At 9 p*m* I realise that s 

it is too late to decide, aince the movie has already started. 

* * 

This book will look at situations in which people feel uncertainty* 
We will discuss* mistakes that we and others make when thinking about uncer- 
tainty We will suggest how to detect fallacies and biases and how to '^void * 
them* In general, we will explore how we can. improve our .thought processes - 
and our thinking under uncertainty* , 

Good Results Do JTot Alwaya Follow Good Processes * Even if we£ couEld con- 
sistently adopt all the recommendations made herein, we castipfc' be^^ure that 
eacK rational and carefully considered decision will lead to the desired re- 
sult* If we decide after careful consideration, during whlch^we avoid \every 
poasible fallacy and bias, to chooae Job A over Job Job A my £till turn 
out to'be £ much worse jbb than Job B. In thia case, although* we adopted a- \ 

good thinking process and made a h good decision, we 'got k pooV^result* 

■ i" \ 

, This ia a natural characteristic of situations in which r feel uncer- V 
tain: The outcomes of our decisions are not predictable JLH 'advance* Tlf^e- \ 
fore, we cannot be sure that, a good decision procesa tttll certainly 16j|d to ~- 
the desired reaults* Our capacity to predict ail outcome-^ advance Itf the p !> 
factor that diatinguishes decisions jmder certainty from decisions J^n^el^ "*\\ t 
.uncertainty* ' * * /jS^C * 

gfi mountain gitide had tfi decide whether to Jtake JJxmte'A or^itpute B* Tate * 
goal was to reach t^e* l^ke as quickly "aa possible. The guide Yn&d ! )that)feoute - 
■ ;A is shorter thanjloute B and' that the routes have aimllar.^unpa^e^ro^ads., 
The. guide^ decided to go the shortest wly* Rppte A,. However, close to ^the Aajke, 



■A 



ERIC 



^7 




i 



i the group, found that Route A was completely blocked by a* rock slide; group mem- 
' bers had to retrace their steps and take Route B* _ 

If someone had asked «the guide, '"Arf.ypti' absolutely certain that taking 
Route A will get you to^the lake fast^pfflijr v ^fet^B?," the response would 
have been, "No, not absolutely cert ai^^at/'pl^tx s,ure/ f Unexpected things 



can happen* No "one could be completay^ii^fl3i6ri^that Route A was clear, but 
one coultl not be completely con^identO^^.^o^t^^-was^^ear either* Tkis is 
a characteristic s^tuatiin in making ^^^b^mi (maifer urafertainty* There was 



nothing wrong with the decision proce^ea^of^tjift^iide* According to thjs^data 
available, the guide made a good decisi^i^^^^^e outcome was bad. *BecaOse 
of an unexpected rock slide, the road was>tftocked and th^ group arrived at thj^ 
l^ke after sunset* + 

We' have seen that a good decision made under uncertainty can lead to x 
an undesired' result * In contrast, consider the following: 
* ■ 

An Israeli visited the United States- .When he came out of the airport, 
he" hailed a cab* The driver looked at him and said, "Are you kn Israeli?" 
The man was surprised, saying, "Yes, I T m an Israeli; how d£d you know?" The 
drive* answer fed, . "That f s easy* You wear a patch on yoiir eye* Hoshe J)ayan 
also wore a patch on his eye* Dayan was Israeli* So I figured you are, tbo*7 
Poor decision processes can" sometimes lead to good results* 



When we feel certain about a specific situation, we can predict 
with complete confidence the outcome of each of our possible actions* 

When we feel any uncertainty about a 'situation, we cannot pre- 
dict with complete confidepde w hat the outcome of our actions will be* 



f 

Under justified certainty,* good dedislon processes are followed by 
desired Results, but under uncertainty, good decision processes can sometimes^ 
be followed by undesired results, while poor decision processes can sometimes 
be followed by desired results. ^ 

. Because of these characteristics of decisions undet uncertainty, there 
is no way to make inferences about the quality of the decision process based 
on the Quality of the results,. You cannot teT.1 th© guide, "Because you are 
late, your decision to take Route A was wrong*" This argument would be as' 
unreasonable as saying, "Ypu did not get six when you threw the "dice; there- 
fore, you did not throw well*" 

It would be reasonable to ask,' "If I.can T t be certain of getting a 
desired result, why should I try to improve qy decision processes?" The 
answer is that the befejer our decision processes are, the more likely good t 
remits are* "Someone who adopts good decision processes gets mo re deaired 
results than someone who adopts bad depision processes* 



■ ^ 
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The rules and suggestions presented in this book are recommendations for 
good thought processes to use when making decisions under, uncertainty* The 
^overriding message- from them is, "Wait a minute'. Think £wiceT" Don f t rush to 
"conclusions*" To adopt these technique^ takes much time and effort* Not all 
^pr^bl^ms/ situations, or questions that arise under uncertainty will require 
special efforts* , Bit if you know the rules for better thinking, you can use 
them for problems that are. especially important to you. * f\ 

c 

. Exercises * ' 

t 1* For each" of the foj^owing decisions, Eirst judge whether the decision 
was good' or bad*. Then, for each bad decision, 'think of a possible good out-' 
come* For each good decision, think of a possible bad outcome* 

a* -Last night, Bill* decided that he wouldn't set his alarm'clock but 

wouia wake up by himself** ' ^ * 

• * * 

b* This morning, t Bill refused 4 to eat an egg that was bought 3 weeks ago; 
instead he ^cooked an egg that was bought yesterday* * 

j ' " " 

c* Bill left the house by jumping otrt a window, although his apar&ment ' 
^ts on the second floor. ^ • 

d* When BUI got to the, bus Stop., ftwo buses, arrived** He took the full 4 
h&s, saying to himself, "Full buses ^et there -faster because, they make ^ewer 
stops/' *- „ • ' 



^ e* When he ayfived at his college, Bill, was late to class* He entered 
another class, saying/ "I have to make life more" interesting- 11 \ 



at 



\ £. -BJ11 had an appointment with a dentist at 2:00 p*m. 
Iv45, saying, "I' don \t want>*any- more ^trouble today* 1 ' 



He arrived 



g* Thtf minute Hill .got home, he sat down to study for his exams, say-> 
ing to himself, u i still feel pretty good* Ltftftr this evening I will feel 
too tired to stody*' 1 * ' * 

h* In the evening, Bill went to visit a friend he hadn f t seen in a long' 

time* - V 

• * * 

i* Bill walked back home, saying to himself, f1 The bus schedule at night 

is terrible* Sometimes you have to wait an'hpur fou a bus* 11 - , < 

* • 

, j. Before going to 'sleep, Bill set hiis alarm for 7:00 in trie morning, 
saying to himself, "I have to learn from e'xperience*'' 

** * m * * * 

2* Think of five examples o^ good decisions which may be followed by. . 

i undesired results*. » 
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DEFINING THE UNCERTAIN SITUATION 



^ * fc Intrftductit 

^ J v "Ax the first of January, 1981, Wilma A* Smith, *the lessor* will transfer 

* . to *ttre 1'esfcee, * George S* Jones, the house keys for the residence at 1850 

Maiiu^tr^et, Parlcington, Illinois/ 1 This sentence from a legal contract is 
fcftmuiated clearly and accurately* The wortfs, "lessor, 11 "lessee, 11 and "resi- 
dence 11 are, explicitly identified* Every word in the sentence has one and only 
one meaning' and the whole sentence portrays a clear message* 

Thi!s strictness, does not usually exist fn our natural language; our * 
everyday language is not built in such an exact fashion* Everyday language, 
. * hecause of -its many uses, includes many t^o^tTwhose meanings are not clear* ^ 
- i Even two people who know, the language *ttill not always take the same meaning 

from a single sentence* For example, a husband and wife are arguing; "Was 
, * last yea£ T s vacation a success?" One says,' "We visited too tn^ny cities and 

* got fejjjiausted; the vacation" was not successful* 11 The other counters, ir We got ' 
1 . to'-spe ,&ew parts of the 'country; it was terrific*' 1 r J* > 

■ ■ ■ . * 

, This situation is one that could be characterized as a certainty situa- 
* tidtt* The vacation ^Ls over and both people know the facts about it* The , ^ 
/ argui&eift Is not about the facts but about the meaning of the term "successful*" 
Tfte dif^xenW^ld^the meaning of terms is important in situations involving 

* 1 certainty* We will see that agreement on the meaning of the terms is even 

mote important in uncertain situations* ^ 

:r+' ■ ■ / 

Suppose the argument took place before the vacation* Will the coming 
vacation be successful? This is an uncertain situation because no one knows 

* how the vacation will actually turn out* Differences of opinion will exist, 
-and tjie" -debate will concern facts about possible future events; but in add!'* 

tlonxjjgrt of the debate will involve a lack of agreement on the meaning" of • 
"a successful vacation* 11 Uncertain situations cause difficulties because of 
their very nature. In order not to make it even harder to cope with these 
^ „ situations ,^one has to.be meticulous about the definitions* Defining terms 
»* is Actually the first stage in looking clearly at problems; therefore, a 
t * clear formulation of the problem is often the key to good decisions an^ 
effigi6n£ actions f " 

# ' t *tn this chapter we hope to convince you of the importande of, clear for- 
mulation in general and in uncertain situations' in particular* We will also 

* - a recommend' a tool that will enable you to test whether a problem Is formulated 

■ clearly^ 
* . ■ 

" ■ . VAguene^s and Ambiguity in Language 

* V 

If we ask for+an opinion about a mutual friend &nd get the answer "nice,** 
' ifre w£Ll not learn much about her character or her appearance. There are many 

words*±n our vocabulary like "nice," "successful," "difficult," or "bad" that 
* point -ou0 the spedkar 1 ^ general intention without communicating much 

\ — ■ » * * 
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information. • In dally life, we, infer the exact meaning behind such general 
WQrds .and phrases with the help of past knowledge a^out the circumstances 
or past acquaintance witfi the speaker* For example, when Joseph tells John, 
n What a nice day," John can interpret it as "The sea was quiet; it was not 
hot; nothing went wrong with^the boat," because the two of them just came 
back from a day of sailing* For someone returning from a tiring trip, n a 
'nice day" might m^an lying down on the sof^ reading a book and drinking beer. 



Vague words convey only a general meaning which we make spe- 
cific with the help of past knowledge and the context in which 
they axe said* ' 



There other words in the language that coflvey a relatively exa£t 
me&iing, but each such word has several possible meanings* Consider the fol- 
lowing example! * o , 

'She wore a hard rock (diamond) on her ring finger* 

* This is hard rock candy* 

- * He. was drilling through hard rock* 

* My favorite kind of music is hard rock* 

- * 

* This rocking chair gives a hard rock* " J 

Every one of the meanings is understandable in its context* In a suitable 
context there is no vagueness about the meaning* We call such worlds ambiguous, 



Ambiguous words are words with multiple meanings 



The Advantages of Vagueness add Ambiguity * There are many domains in 
which .vagueness or ambiguity in natural language is. a positive contribution* 
A good example is the symbolic language cff literature* The poet David Fogel 
has described his childhood as "blue*" Jle did not intend to provide b an exact 
definition of his childhpod* Instead, In the phrase "blue childhood," he 
tried ^to convey general sensations concerning his childhood;" blue sea, blue 
sky, peacefulneas ♦ * Blue also evokes thoughts of inner sadness or even^of 
puritanism ( n blue laws")* But l^his list of meanings does not exhaustithe 
possibilities* The poet and the reader can find a broader and deeper meaning 
for the expression '"blue childhood*" The poet chooses or even invents vague 
or ambiguous words and expressions; tpe more such expressions, the richer the t 
poem* 

Another use of vague language, irhich all of us take for granted, is not 
the language that makes a* poem rich, metaphorically, but the language that makes 
the writer 'rich materialistically. f This is advertising language; "Things go 
better with Coke," "Marlboro Country, '* or "Reach, out and'touch sofl£one* M With 
vague and ambiguous expressions, the writer tries to influenc£JEt/e listener 
without the listener's awareness yf the ambiguity, /"""^ \ 
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In daily life, we sometimes use vague or ambiguous language to.avo&i 
conflict or to be polite* If somebody asks us, lf What happened to Fred? t Why 
isn't he in your office any more?, 11 we may prefer to answer, f 'It didn't work 
obt," rather than goin£ ±nto detail with, "Fred got fired because he came late, 
quarrelled with others, and was sven suspected of dipping into the till*" 'By 
saying,, v?It didn't work out," we leaVe the meaning intentionally ambiguous* 
In daily conversation, a really specific answer would often sound ridiculous* 
For example, "How are you?" No one would be likely to answer ia detail about 
♦body temperature, a lingering cough, recent mood changes, etc* - 

Even in formal language, ambiguity and vagueness are sometimes used 
intentionally* In the peace settlement between Egypt and Israel, there was t 
mention of future talks about autonomy with reference to the Palestinian prob- 
lem* But autonomy for what or whom? This was left unspecified so that in 
discussing the treaty ^ Begin could say the autonomy referred to the Palestin- 
ian people , while ^Sada£ could say it referred to the disputed land . 

In summary, there are many advantages to vague and ambiguous expressions 
in natural language* 



Vague or ambiguous expressions can (1) activate the listener's 
imagination, (2) conceal information, or (3) avoid conflict. 



The Disadvantages of Vagueness and Ambiguity . The trouble comes when we 
use vague and ambiguous expressions unintentionally or unnecessarily* A vague 
formulation of a message may cause misunderstanding, wrong decisions, or £&ul£jr 
interpretations* Most of us remember saying, "I didn't intend to insult you; 
you simply didn't understand me,' 1 or "That's not what I meant at all. 11 After 
a long argument, we hear, "Ah, is that what you're driving at? I agrte com- 
pletely*" Vagueness causes misunderstanding because of the gap between the 
meaning the speaker intends and the meaning the listener is getting* 

Henry claims that during the last 2,000 ye&rs, humans have not progressed. 
Helen claims that humans have made astonishing progress*^ The debate between 
the two relies on the meaning of "progress* 11 Henry means moral progress; he 
does not see any* Helen means technological progress, which obviously has 
occurred* 4 

Dan and Paul are discussing the need for a Saturday committee meeting* 
Dan says, "We have to start early because the agenda are so long*' 1 Paul says, 
^No, I like to sleep in on Saturday* Let's start late*" Will they have a 
rancorous fight and cancel the meeting without eVe£ discovering that Dan's 
''early' 1 on a Saturday is 9:30 a*m*, which is also Paul's "late 11 ? 

A3 a first step in an^ argument, the two sides must test the terms* 
Do they understand each other? Do they agree on the interpretation of criti- 
cal terms V^t When each one of those taking part in an argument means something 
eise by t tlie same term, they will not argue witft oidRnother but in parallel* 
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ifhedebaie over human progress in the last 2,000 years should begin by 
inching ail agreement concerning the stibiect. Even after an agreement that 
the topic is "moral progress/' debate m^y continue* Helen can argue that 
elim inating -the death penalty means moral progress, while Henry claims that 
it is a retreat* But this is a debate about substantive values, not a debate 
based on Misunderstanding* . x 



-Vague terms cause misunderstanding* 

Early agreement should be reached on the definition ofc terms* 

A debate af£er such agreement may be^fruitful and interesting* 

A Rebate based on vague and. ambiguous terms is pointless and 
unproductive. v 



Exercises 

1* Findjin the newspaper or any piece, of literature 10 examples of 
intentional vagueness* 

✓ 2, Look at «a weekly horoscope , u 

• Find the vague or ambiguous words* 

v ' / 

• Rewrite the horoscope replacing each vague^o/ .ambiguous word with 
a clear one * * i* > 

» • Did you learn something about horoscopes? 

^Jhe Clairvoyance test * When we are in an uncertain situation and we can- 
not decide between .a dumber of possible answers to a question or problem, we 
must first clearly define the problem that faces us* How will we know when 
the problem is 'clearly defined? 

• ' /-•■"' 

A test fg^determining clarity is the "clairvoyance test," Imagine a 
person who knows the answers to all possible questions* * This person is called 
the "clairvoyant*" THe clairvoyant knows all that happened in the past, all 
that happens in the present, and all that will happen la the future* But the 
Clairvoyant knows only facts and cannot make interpretations ott inferences* 



The clairvoyant knows all facts but do&s not explain, interpret, 
or infer* P 

k term, phrase, or statement passes the clairvoyance test if the 
clairvoyant, relying solely on factfe^ is able to say ^aether the 
statement is true or false* ^ 

•* 

A question pisses the clairvoyance test if the clairvoyaat, 
relying solely on facts, can answer it. ( 
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1» How many people will attend the lecture? 

2, Wtll the audience be large or small? 

The clairvoyant can easily answer the first questioft: "One hundred forty- 
three people will attend the lecture," The clairvoyant will not be able to 
answer the second question because it is not cle£r whether 143 people is a 
large audience or a small audience, 

A local group is sponsoring a public debate on creationism versus evolu- 
tionism in the public schools. Two members of the group want to decide 
whether it will be a "hot debate," The importance of a clear definition may 
be seen if we assume that such a debate has already taken place, that the two 
members were present, and that they cannot agree whether the debate was hot, 
or not. One says it was a hot debate because it went 20 minutes over the 
scheduled time. The other one claims that it was not a hot debate because 
the discussants were all polite to the finish. How could they define hot 
debate to avoid this disagreement? A hot debate could be defined as "a debate 
that lasts long after the scheduled time," This definition would not pass ^he 
clairvoyance test because the clairvoyant would not know how many minutes or 
hours "£ong ajfer" meant. Definitions like "the debate lasted more than 2 
hours" or "at least two discussants raised their voices above 30 decibels for 
at least 10 seconds" would probably pass the clairvoyance test* After the 
debate, any one of these definitions could be used to decide whether it was a 
hot debate. 

Will my two friends become reconciled? The phrase "bepome reconciled" 
must be defined before this question can pass the clairvoyance test* We 
could uiefine it as "my two friends will say hello* to each' other when they 
next meet'* or as "one of them will invite the other to dinner within the next 
month," Either of these definitions would pass the clairvoyance test* 

Of course, saying hello is not really all that is meant by "becoming 
reconciled," Often a definition that passes the clairvoyance test will, be 
much narrower than the ordinary meaning of a phrase. One way to broaden the 
definition is to list several specific behaviors, any one of which would be 
taken as indicating reconciliation: "They say hello next time they meet, or \ 
one invites^the other to dijmer^within the next month, or_ they talk together 
on the phone, at least on&s within the next month," This definition is broader 
but still Basses the clairvoyance test* Even so, such definitions do not 
capture the subjective .feelings of friendship and af feet ioi^ that reconcilia- 
tion implies. Clear def initions.that pass the clairvoyance test will not 
always contain all the rich implications and associations of ordinary lan- 
guage. But the clarity that the clairvoyance test assures is necessary' for 
effective decisionmaking f * f 



For effective decision making, all terms in the*problem state- 
ment should be defined so that they pass the clairvoyance test. 
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Is the road *to Sarah's mountain cabin <a bad road? What ;Ls a "bad road? 11 
A road could be bad because it has steep hills or ©harp curves or because it 
is narrow or deeply rutted* Each of these characteristics, in 'turn, requires 
further specification (how steep is a steep hill?)* Many definitions are 
possible, and each could, with care, be worded so as to pass the clairvoyance 
test* Which definition should we use? To choose the best definition,^ we 
need to know wny the question was <asked* What decision rests on the answer? 
If the question was asked because the county is considering taking over the 
road, the best definition of "bad road" may be "costs more than $2,000 to, 
bring up to county standards*" But if the decision is whether you will visit 
the cabin thiS'weekend, the best definition of "bad road 11 may be something 
like "cannot be negotiated by a 1980 VW Rabbit in second gear without damage 
to the car*" ' ' 



■ Exercises ' * 

1* The second question in the exercises for the previous section asked 
you to rewrite a horoscope* Do all the components of the rewritten horoscope 
pass the clairvoyance test? If not, improve them* 

2* Define the following phrases so that they will pass the clairv<?yance 
test. Give two definitions for each phrase* 

• A clever man, 

* A thrilling book, 

• A frightening movie, . fc i 

* A grave situation, ' «\ 

* A just trial, 

• A good teacher, 

* Nice weather, and * t 

# A wealthy man* 4 * 

1 1 

3* ^ The definitions you gave in Question 2 were probably Narrower than 
the ordinary meaning of the phrases* For each phrase, give an example that 
suits the ordinary meaning but does^not fall under either of your two 
definitions * 

4 4 
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CHAPTER 3 \ 

LISTING AND .GROUPING POSSIBLE ANSWERS 

The Importance of Considering All Possible Answers ' 

In a day care center, the teacher was shocked to realize that a 3-year- 
pld child was missing* She had arrived at the day care crater as usuaJL, played 
with the other children, had a snack with the* class /and an hour after the snack 
was found to be missing. The teacher asked the neighbors to help him look.foj: 
the child in the area surrounding the day care building, "She probably did not 
go far away iif.l hour; ghe's only 3 years old* 11 When the search was in vain 
the teacher called the police* Police forceS c got organized for the searching 
process* They listed the possible whereabouts bf the missing child: 

* Inside the day care center (perhaps she wanted to hide somewhere and 
fell asleep) , 

* In the area surrounding the day care cente^, within a radius of half 
a mile (a 3-year-old child is not capable of going very far in an 
hour's time), 

* 

* In a park 2 miles from the day care center (perhaps she was taken 
there by somebody), or " * 

* In any other place, farther*than half a mile away (perhaps she 
climbed in a parked car that b^gan moving). 



-Only after raising these alternatives did the p&X&ce forces tiegin their 
search* 

If we compare the police force response to the situation to the teacher'3, 
we can see the police wete much more efficient* The teacher did not think 
about different possibilities Decerning the whereabouts of the child* He cen- 
tered his actions, around the, one possibility thst he tho_ught ^ks most likely** 
The police also raised the possibility that the child was somewhere near the day 
care center, but they considered other possibilities as well* The child may 
finally be found near the day care center, proving that the teacher was right, 
but we h?ve previously learned xiot to judge a decision process according to the 
result* The fact that the child was actually found to be in the neighborhood 
does gat prove that the thought processes of eliciting and acting on only one 
possibility is the right process, 

Hhetvwe think about a problem about which wo feel uncertain, there are 
.some advantages in listing all the possible answers, even the less likely ones: 

1* The elicitation of other possibilities, with reasons for them, weakens 
our overconfidence in" the first elicited possibility* If the teacher had 
spoken with the police, listening to their possibilities and arguments, 4 prob- 
ably his confidence in the idea .that the child is , near the building would have 
been weakened* He'would probably have thought, /'I have to admit that I didn f t 
think about those possibilities* 11 ^ 

J 
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2* When one raises only one possibility, activities directed at other 
possibilities are completely neglected* All efforts are centered aroun^ou'e 
most favorite possibility; all the neighbors looked for the child around the 
day care center* Even if, after cqnsidering all possibilities, action were 
to be focused on just one possibility, the explicit listing of the other pos- 
sibilities prepares us mentally for those other possibilities* If the child 
is finally found in the park, it will be easier to adjnst quickly tq the idea 
that she is there than if we had not thought about it before* We will be ' 
less surprised to find out that she is in the park after raising this as a 
possible place than if we had never thought about it at all* 

3* The listing of other possibilities can also be of practical impor- 
tance* If the child is not found near the day care center, searchers will be 
^ent more quickly .to other places* There are also situations in which it will 
be possible and efficient to act on many possibilities simultaneously, sending 
some searchers nearby and some to the park* 

^/4* One does not always act in accordance with the most probable possibil- 
ity. Even if the police believe that it is most ptobable that the child is 
near the day care 'center, they may prefer sending searchers to the park where 
there is a deep pool, because of the danger for the child* Jn those situa- 
tions, it is most important to think in7advance about many possibilities, even 
those that are unlikely* \ 

" \ 



It is not appropriate to focus on the first possible solution 
that comes to mind concerning a problem. It is bettet to think, in 
advance, about all possibilities* 



This process of listing all possibilities in advance enables us to choose 
a possibility that is judged by us to be the most suitable (not necessarily 
always th$ mast ^robablej* Moreover, we can prepare ourselves mentally, and 
practically for additional possibilities judged by us to be less probable* 
Finally,, listing all possibilities enables us *to plan for simultaneous action 
relevant td several possibilities* For example, the designers of nuclear 
power plants try to think of all possible ways the plant could "fail yso that 
they can design pafety systems for all those possibilities* ^ 

tfw we should list all possibilities and how we should organize them 
will be covered in the next section, 1 v 



Exefcises 



1* , List as many possibilitiea as you can to explain the following situa- 
tion: '"'*'* . he woke up and looked at his watch; the small^hand pointed to 
5* Some lif£ht entered the room* His wife was not near him* He remembered 
that she told him she would coske home at midnight*, ,He became anxious * He ran 
to his phone and called his parents* His father answered in a drowsy voice* 
No, his wifeis not there* He asked whether perhaps his wife arrived while 
Ms father was sleeping* He got a ijeg&tive answer* He considered his next 4 
st^ps*** * * 
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* , * 

2, My car won't start* List the 10 most likely causes, 

* 

3* The phone rang at 6 a*i&* When you answered it, there was only a 
dial tone* Why? List the five most likely possibilities* 

Structuring Possibility Lists , 

Example A * You meet a person* Was this person born in Canada? The' 
problem is clearly defined, and it is, easy to list the possibilities* There 
are only two: (1) yes and (2), no, 
* 

Example B » I have a die in my hand. On which side will^ it fall? The 
possibilities ar e (l) one, (2) two, (3) three, (4) four, (5) five, or (6) six* 

Example C , I have a current American coin in my hand* Which coin is, it? 
The list is (J>) penny, (2) nickel, (3) dime, (4) quarter, C5) half dollar, or 
<6) dollar* . 

We will call such lists "lists of possibilities." In all three examples, 
it is easy to list all possibilities* But if the question in Example A had 
been, "In what country was this person bom,?, 1 ' many possibilities would come 
to mind. All the countries in. the world are possible* In a situation where 
there are many possibilities, we often will not want to, or not be able to," 
list all the possibilities. 



When we have many possibilities, it is worthwhile to group them 
categories; each category will contain a number of possibilities* 



into 



Grouping into categories is guided by a certain rule , * For examplS, we 
could group the countries according to continents , Thus there are seven cate- 
gories of possibilities (one for each of the seven continents); each category 
(continent) will contain a number of possibilities (countries) * ^^ie catego- 
rization could be guided by a different rule* for example, langiia^fe: English- 
speaking countries, French-speaking countries, etc* The number of categories 
will be the ^number of languages .3 

Categorization is not a process'that we use only in uncertain situations* 
We encounter such a process^ daily under another name: classif icat ion * ( For 
example, a library is interested in organizing a catalog of books so that 
people can easily find a specific book* The bookk have to be classified 
N according to one or more specific rules* A book can be classified according to 
one of the following systems or according to several of them simultaneously* 

/ 

1* For classification according tp subject , each subject (topic) will 
'be a -category*- and in each category*the number of possibilities will be the 
number of books on this Jfbject* / 

* : / 

^Thexe are a few countries with more than one official language* These will 
caude problems for grouping, which we will discuss later* / * 

/ 



/ 
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2* For alphabetical classification according to the title of the hook, 
each letter is a category and the number of possibilities in each category is 
the number of spooks whose title begins with that letter* 

3. For alphabetical classification according to name of author ; again, 
each letter of the'alphabet is a category. v 

Any other classification is possible as long as it is useful. 

One can subdivide any list>of possibilities (see Figure 1) into a few 
broad categories, each of which contains many possibilities (see Figure lb), 
or into many narrow categories, each of which contains ftew possibilities 
(see Figure 1c). An extreme case is the case in which each possibility has 
a different category &see Figure la). * / 
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categories with 6 possibilities each 
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(c) 12 categories with 2 possibilities each 



Figure 1, Categorization of 2£ possibilities. 

The decision cpncernlng the*"humber of categories depends, of course, 
on the problem, on the purpose of the classification* 'When one has to rely 
on one's memory, about fiye to seven categories are most efficient, t^cflre than 
seven categories place a strain on Our cognitive abilities, while fewer than 
fiye may leaves, too many, possibilities in each category* * " f 

Let us look at another classification problem: How should you fil^he 
bills on your desk? Vou want a system that is logical so that you can fl^dkly 
find an, old bill when you need it* You could file tiiem by month: All bills 
paid in one month go in the same file* Alternatively, you could file them by 
payee: All the phon$ bills go in one file. Can you think of any other ef- ■ 
fiqient f ilin^system? 1 

r ' / ■ 
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' Exercises 

1, Group the possibilities you raised In Questions 1 and 2 In the \* 
exercises of the previous section Into categories* Give a name to each ^ 
category* -/ ^ 

2* Classify the books ln^btir private library Into five to seven cate^ 
gories*. Give a name to feach category* What Is your classlf lcaq£on*rule? 

Necessary Requirements for Category Lists 

\ 

Clear Definition * Just as a problem has to be cleatly defined and has 
to pass the clairvoyance test, so do all the categories (or the possibility 
if we 4<> not group)* We have to define the category names so that the cl&lr-. 
voyant could say without any doubt into which categories every possibility ^ 
falls* If the police forces asked the clairvoyant, "Where is the-chlld — in 
the d$y care center, around It, or far from it?," the clairvoyant would not 
have been able to answer because it Is- not clear what exactly is peant by 
"around" or "far*" But if asked, "Where is the child— in t;he day care center, 
within** radius of half a mile, or more than h^lf a mile?," the clairvoyant 
could have answered. * 

Consider another example; f 

Alices How many burglaries w^re committed in your* neighborhood last 

year? 

Tony; Not so many* 

Maybe AWce knows what Tony means by "not so many," but the clairvoyant 
does not* Thrf'clairvoyant could not answer the question, "How many burglaries 
were there — few, not so man^,\or nfiany?" The clairvoyant knows that' there 
were exactly 10 burglaries, but is 10 few, not so many, or many? The clair- 
voyant can , answer the que&tlon, "How many burglaries were there—less than 10,* 
10 or more but less ;than 50, or 50 or more?" 

I 

It Is not always easy to give precise definitions to_all categories* L 
Of ten, the differences are not very clekr, and the boundaries between categories 
are vague* For example, when you get a driver's license, you must state your 
eye coIqt* Eye colors arV'problematic In the sense that they are not clearly 
defined* .When does blue become green? In spite of those difficulties, the 
t usual classification is (1) black, (2)* brown br hazel, (3) ,grey, (4) blue, or 
(5) green. However, even the clairvoyant may have difficulty In deciding 
how to categorize the eyes of someone whose eyes are bluish green, varying 
with the color of clothing* The categories are not well defined* (One could 
define eye color qnl the basis of vave lengths, but the measurement would be 
expensive and not Vpry'practlcal*) In difficult cases, we should agree, In t 
advance, on a classification method for assigning each possibility to a cate- 
gory* -One method is to specify, in advance, that there is a jad^e who decides 
how to classify each case* For a driver's license, the applicant la the # 
judge; all people decide their own eye color* In other Situations, we can 
select a judge, or eWn require tiiat.two people agree on the classification, 
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h a third person to resolve tie&* We cou^tf f for example, specify an expert 
will, decide, for countries, in which- mare than one language la spoken, «wfcat 
prlmary'language x " ^ f * 

Asf^we call for strictness In the -clear definition of the gfobl^gi, %or^wk* - ' 
I havaHto be very strict about a clear definition of the "categories^ It * 
Important so that each possibility has a place ,in the classification, and 
re will be no arguments* *When clear t deflnltlons are difficult, ^we^wlll 
:come the ^difficulty by specifying a cjfcsslflcatlon method In fcdvaijce^ 

■ • S / • ^ ■ 

Sometimes developing clear definitions for categories will serve to*l 
r^f^a vague problem* For example, we could envelop categories 1>y wirich ^ \ 
rlasslfy roads* The category "bad road" migjit be roa^s that haise potholes . . / 
nits more than 4 Inches deep, and so forth* Such category deflrilt Ions ^ * * 
.d^ttifen clarify what Is meant by the question, "Is the rpacF bad?" 

Clear definition Is a necessary condition for a good list of categories,. 
It Is not a sufficient condition* For a good list* we will n6ed further \ 
ilrements* - 

TSahaus^lveness * Each list of categories must be exhaustive, that is, 
iust be capable of Including all possibilities* 

In the classification of motor vehicles, the license bureau creates 
gcrles snch that all motor vehicles will have a place; trucks, buses, t s - 
s, private cars, motorcycles, and special cars* ™ 

When we say that the year Is divided Into four seasons, autumn, winter, 
ng, 'and summer, each^of, the 12 months can be assigned to a season* 

It Is not always easy to create an exhaustive list* 

J 

Example A » 1 decided to classify the books In my private library accord- 
to subject* *I> could put most of my books under Qne of these categories; 
fiction, (2) poetry* (3) science, (4) philosophy, or (5) ar.t* After putting. 

of the books lftto these categories, I find some books left; a dictionary, 
rif of puzzles, $h?ee cookbooks, and a book on photography* I could add \ 

categories, one category for each of those books, but then I would h£ve" 
uany categories/ some of them with one Item only, - V 

A more practical solution for the above problems would be to add only one 
clonal category to wjl<^ all the remaining books*will belong* The name of 
category could be "other" or "miscellaneous/' The additional category 
assure that the list will be exhaust lve-*-eveify book In my library can ^ ~ 
;brlzed* For £he classification of motor vehicles mentioned above,, 
;lal cars" was actually the miscellaneous category* , * 

Example B * Y The editor of the local newspaper grouped the news: if*o four # 
torles: (J) International news, (2) national news, (3) lofcaloiewe* andt . . 
icorioinic news* News for tJ^se four categories comes across tTfe desk every 
but what abou^ all other news? A new Miss Uhlverse was elected, new re- 
h'on cancer has promising results, etc* Should the editor add more cat£- 
ts for medical news, for beauty competitions, or-for anything felse which' 
■ along? This would be 'ridiculous; almost every day some unpredictable 
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events hapjJfen th#tf would' not fit into any category* Again, it is worthwhile 



^dding only on^ i&ore category, "miscellaneous," into which all the. other news 
will be grouped* In this way, we ensjure that the list of categories' is ex- 
haustive^ there are not too many categories, and tftere is a proper* place for 
unusual or unpredictable news, Go back to tfre example at the start of this 
chapter; you* will see that the" Tist of categories the police developed con- 
cerning the whereabouts of the child ^as actually an exhaustive list. 
* 

A miscellaneous category is especially important in uncertain situations, 
when it is difficult to think about all possibilities ,in advance* 

Exclusiveness * We now add a further requirement* Nofc otily should every 
case have a place, but it should have one and only one place * The categories 
have to, be defined in such' a way that not more than one of them will include 
the same possibility* Ruth and Nancy have a game; a board #ith squares on 
it, dice, and toy soldiers* They decided to inventfnew rules for the game so 
that it will be more interesting* Each player tries to move her soldiers to 
the opposite side* The one who moves all her soldiers first will frin* The 

rules for moving are £S follows: * 

J • * * 

1- Each player iji turn throws- the dice*. 

2* If she gets an*even number, she will progress as many squares as 
shown on the dice,* 

* . ' * V 

3* If she gets an odd number, she will /retreat as many squares as shown 
on trie dice* 

4* If she gets a number divisible by three, she does not move* 

' * ' - ' - * * * . \ * 

The*two begin playing* Ruth throws the dice and gets a six* "Marvelous, 

I can progress six steps* 11 "No, t! responds Nancy, "six is divisible by threej 

yon have to stay where you are*" 

Of'coujrse, Ruth and Nancy t s new rules are no .good because one outcome was 
represented by two rules .(possibilities); six is an even number and a number 
divisible by three* In Pther words, the categories .w^re not exclusive * In 
the above example, poor grouping caused only an argument, but if the police 
forces search all possible areas' for the missing child, nonexclusive possibil- 
ities may cause duplication of effort*, 

- TitoS'the third requirement is fhat the categories in the list of cate- 
gories mu^t be exclusive* The only way to check" "Whether the categories are 
exclusive is by logical testing; we have to imagine a case suitable to two or 
more categories* Consider the following example* In ait attempt to create 
categories for vertebrates, we decided on five categories'; (l) mammals, 
(2) reptiles:, (3) 'birds, (4> creatures with fins, and (5) other* ,1s there a 
'vertebrate that is included In more than one category? Yes, the whale is a 
mammal and has fins; thus, it belongs in both the first and the fourth cate- 
gories* The categories are therefore nonexclusive* In the^same way, we could 
think about the piece of news that is simultaneously mt±<Sml news adtf economic 
news* Oftqn it is easy £p.oyercome nonexclusiveness by redefining the cate- 
gories* Try the biological division of vertebrates: fish, amphibians, rep* ^ 
tiles, birds, and tiammals* * 
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Sometimes it is difficult to create exclusive categories, as with the 
news problem* One of the following solutions can be adopted: 



J l* Allow the person who groups the items the freed 
category to put the possibility* (This solution is like 
posed when the categories did not have clear definitions 
will decide how to clasl&ify each piece of n'ews* * 




decide in fyhich 
lution we pro-> 
newS editor 



2* Use "miscellaneous" as a dategory for all ambivalent cases. Then, 
eaph category will*be defined as "predominantly economic news," /'predominantly 
international news," and so forth. The miscellaneous* category will include, 
for example, news about an international economic problem. The disadvantage 
of such a solution is that the miscellaneous category quickly becomes too 1?ig* 
Try t6 avoid using these two solutions whenever possible* Instead, try to 
find a list of naturally exclusive categories* 

Let us summarize all three requirements for making lists of possibilities 
in uncertain situations: * - 



1. Each category of possibilities must be clearly defined* 

r 

2* The list of categories must be exhaustive — include? all 
expected and unexpected cases* 

3* The list of categories must be exclusive— each possibil- 
ity should fit into only one category* v 



In a sense, these three requirements pan always be mSt by technical means* 
One can achieve clear definitions by specifying a judge; th^n each category is 
defined in terms of that judge's .decisions, Exhaust iveness can always be 
achieved by adding one more category, "other*" Exelus^veness can be achieved 
artificially by limiting each category to possibilities that cannot belong in 
any" other category and by saving the n other !t or "miscellaneous 1 ' category for 
all mixed possibilities, thus, 

* * * 

• All As that are not also Bs vr Cs, * 

• 'All Bs that are not, also As or Cs, 

All Cs that are not also As or Bs, and t 

• All other* 



However, such technical solutions do not always lead to the ra&st useful 
categorizations. Additional characteristics of useful categories are dis- 
cussed In the next section. — - 
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Exercises 



1". in Question % of^he,exercises in the previous section, you* classified 
fehe.'books in your library* Check that the list of categories you created 
satisfies the above three requirements* * . 

2, Check and criticize the following lists of possibilities; 

\ a* What will the color fcf the, traffic light be when I arrive at 

* the 'intersection? ? , 

? - ++ - 

• Red, 

Yellow, or * 
> v . • Green/- 

v b* How will the coin fall?, 

' . • Heads or 

" * Taifs* ' > 

' ' * c* How many coins are in ray pocket? 

• 6*8, or 

• 8-10* - k 



d, frhafc is his profession? 



• ''Scientist, 
K' Wrieer, 

Blue ? dollar worker, 
^ • . Teacher, or 
Other* 



tef"'* " *e* What book are you reading? 

A Prose, t 

* '/ * Poetry, 

* " • * Scientific *literaturfe, or 

4 ■ 1 • Professional literature* 

' f * Where did the tourist come from?, 



f^ Sm ^' m • Japan, 



^ • Europe, 
% • Australia, or 

• , New York* 

■ t * 

.3* Por each of the lists you criticized in Question 2, suggest a better t 
-list* If you have difficulties, list them: 
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More Requirement sj for Lists of Categories 



Each list of categories must pass some necessary requirements* But for 
many problems, we can create more than one list of categories, all of which 
satisfy those requirements* Which one of these well-defined; exhaustive, andj< 
exclusive lists Is moist efficient? Let's go back to the missing child example, 
We have to devise a » search plan for her. One possible list of categories Is 
the following:: 



• Inside the/ day care center 



•i 
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• Within a radius of less than 100 yards of the day care center, 

• Within a radius of 100 yards or more but: less than 500 yards from 
the day care center, 

• Within a radius of 500 yards or more but less than' a mile from the 
day care center, ' 

• Within a radius of one ipdle or more but less th£n 5 miles from the 
^ daycare center, and ' / 

* * ■'* 

• All other possibilities* - ^ 

This list passes all three requirements: The categories are well defined, 
exhaustive, and exclusive. But we can suggest another list of categories 
for the same problem: (l) The child is with a relative, (2) the child is 
with friends of the family *j£3) the ctiild Is with strangers, and (4) other 
possibilities* This list is also well defined, exhaustive, and exclusive. 
Those two lists stress a different aspect of the same problem* The first 
list focuses on distance from the day care center * r The second list focuses 
fin the question, "whom is the child with?" The decision about which list 
to use depends primarily on the purpose of the listing* In this example, 
it depends on how the police chief wants to organize the search* Should the 
forces be sett to search in ajeas around the day care center, or is it more 
efficient to send them to look for family members and friends? If the 
police chi£f believes that the child is not just wandering around bufc went 
to find someone, one of her friends or relatives, the chief would probably 
prefer the second list of possibilities* 

^ ^ Consider another classification problem* The area of a certain city can 
be divided into subari&as in different ways according to different purposes. 
There is a division of the city into neighborhoods; this is a division which 
is important for city management in order to provide services to all neighbor- 
hoods* The same city can J>e divided according to the density of population 
so that the mall can be delivered efficiently* In the first division, accord- 
ing to neighborhood, each subarea is approximately the same size* In the 
second division, the subareas vary greatly in size (Figure 2)* 



J 



The selection of a set of categories depends on the purpose of 
the categorization. ' r 
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Areas sijgllar in size 



Areas according to population density 



Figure 2* Dividing a city into subsreas* 



Often, the important aspects of the probl^^ emerge from the definition 
of the problen itself; we are then not free to choose the categories* The 
title of a local radio news show is News Across the Country* In this case, 
the grouping of the news is according to areas and not subjects* Similarly, 
in the case of the missing child, if we ask, "With whom did the child leave?," 
the question directs us to a specific list of possibilities* 

In otheif&ases, the categories are given, and we learn about specific 
aspects of the problem from the categories* Suppose the problem Is, "Bow do 
Americans spend their free time?" Consider two lists: 

1, List A 

• Entertainment inside the house (TV, conversation, etc*) t " ^ 

• Indoor entertainment not in one's home (concerts, theater, etc*), 

* r * 

• Outdoor entertainment (trips, sports, etc*), and 

% Miscellaneous* \ 

* 

2* List B ' 
; V Solitary entertainment (reading, TV, etc*), 

• Active social entertsinment (dancing, conversation, etc*), 
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• Fassive social entertainment (movies, lectures, etc*), and 

* 

• Miscellaneous * * 

Each of m these lists presents one aspect of the problem* tist A stresses 
the place of entertainment; tist B stresses the amount of social interaction . 
One can think about a third list which stresses the amount of time spent* 
The' purpose of the listing is revealed by the categories* In this sitti&tion, 
even if the problem, is not well defined, one can learn about the purpose of 
listing from Che names of the categories* 

After we choose a specific aspect of a problem (searching for the missing 
child according to "distance" versus "people"), we can still group the possi- 
bilities into categories in different ways; tist A — with relatives, with> 
friends*, with strangers, miscellaneous — and tist B— with her sister, with 
her uncle, with Michael, miscellaneous* Again, the preference for one of 
these list.s over the other depends on*the purpose of the classification* 
For the police it may be more important ta know the exact names of people 
than to, work with general categories* " * * , 

I ^ ^- ' ■ 1 

Even if the aspect is known, selection of a list of categories 
depends on the purpose of the categorization* 

: r 

t There is one more point worth mentioning* * When there are so many pos- 
sibilities that we want to group them into categories and when there are no 
special requirements leading us to group according to specific aspects, it 
is desirable to have approximately the same number of possibilities in each 
category* An invitation to a potluck often specifies that if your name 
begins with one of the letters A through D, bring a salad; E through K,. bring 
a main dish; t through Q, dessert; and R through Z, drinks* These categories 
were selected by counting the pages in a telephone directory, to ensure that 
approximately 25% of all names fall in each category* When such a system is 
used, the potluck should have approximately the same number of salads as main 
dishes, and so on* r 

In problems involving uncertainty, thistidea expresses itself as a re- 
quirement that we will try to^feroup possibilities in such a way that each 
category is more or less equally likely* If telephone employees are assigned 
to atfSwer questions an!d complaints* an assignment based on single letters of 
the alphabet would not equally distribute the work load* The employee answer- 
ing only the complaints from people whose last name starts with n I M would have 
little to do, while the "S" person would be swamped*, But if the alphabet were 
categorized as it was for the potluck, the probability of a caller having a 
last name that falls in a given category is approximately the same for all 
four categpries** Assigning employees on this basis would thus, equalize the 
work load* 

To summarize, categories, for the possibilities of an uncertain situation 
must be clearly defined, exhaustive, and exclusive* When these criteria are 
met, categories should be chosen to reflect the central aspects of the prob- * 
lem* Winally, whenever possible, it is efficient to select categories in such 
a way that all are approximately equally likely « 
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Exercises . t 

1, For each of the following problems, prepar^a good and efficient 
list of categories, 1 J - 

* John came home from work and found no one at home. Why? 

* Ky sister is ill, What is her illness? 

* What is the height of the tallest man to pass by your window within 
the next hour? 

* " The fire began in the factory. What caused it? 

* What kind of sandwich is that?, 

* What kind of car will your friend buy? \ 

* My Time magazine did not arrive. Why? 

2, Two people are interested in each of the following problems. For 
eacfi problem, create a list of possibilities' for each person, 

a. What score will .1 get in the biology exam? 

* First interested person; a good student 

* Second interested person; a poor student 

b. What will the weather 6kJ.ik£ tomorrow? 

* First infcg/ested person; a soldier with a long march tomorrow 

* Second interested person: an organizer of a competition for 
model airplanes 



c. I called Allan and, there was no answer. Why? 

* First interested person; his friend 

* Sedond interested person: a thief 

d. What flower do I hold in my hand? 

P First interested person: a botany expert 

* Second interested person: a child 

e. How much does this cake cost? 

* Firs^/ interested person: a person who is going to buy it 

* Second interested personr- a person wha has on^f $1 



f * A truck was c stuck atf the middle of the intersection and could not 
get started* What is the reason? *• * 

* First interested person: the driver of the truck 

• Second interested person: a police officer 
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CHAPTER 4 



% DEFINING DEGREES-W BELIEF 

Introduction 

The elicitation of a good set of possibilities Is a necessary step for 
taking reasonable actions pr making decisions. However, It Is not a sufficient 
step. Even when the set of possibilities Is well defined, exhaustive, and ex- 
clusive, the listing of possibilities does not, in itself, indicate which 
decision or action is bestu For the decision as to how to deploy the police 
searching for tife missinfe child, (see chapter 3), the listing of the possible 
whereabouts of the child is t not enough. The decision depends on our con&L*- 
dente in each one of the possibilities (as well as on other considerations)* 
Thus, an additional necessary step in*any decision we make is to define our 
confidence or degtetf of belief in any one of the elicited possibilities. In 
chapter ,1 we saw that the degree of belief is a personal, subjective feeling} 
its external manifestation can give an outsider an idea about it** In the 
present chapter, we will inquire into the ways we usually express jlegree of 
belief,- and we will discuss how It actually should be done . 

Usual Expressions of Confidence 

Consider these expressions of degrees of belief: 

1. Jones: Will we win the case? 
* * * 

The lawyer: There is a chance we will. 

* 

2* Smith: If I buy a pew $200 part for my car, will it bring an end 
to the car's frequent needed repairs? 

The mechanic; I can't guarantee that, but the chances are not 

negligible * ^ : " , 

3* Carol: David, are you coming to th$ concert tonight? 

David: Maybe * 

£. Physician: Ms, Miller, I recommend that you undergo an operation 

which is not easy and even risky, but it is worth doing* 

Ms* Miller: What are the chances that the operation will succeed? 

Physician: There's a ftffffJ chance . 

} r 5* Ben' (to the palm reader): rfill I pass, the examination? 

Palm reader* It's very likely * 
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6* Paul: Do yod 1 think it will rain tomorrow? 

v Biil: Probably ; it is cloudy outside* 

Don: Do you think it will snow? 

Bill: T!^at 's probable , too* 

Mark: But less probable than rain* * 

These six examples are concerned with uncertain situations* The mechanic, 
ptgrsician, and even the palm reader cannot give a certain answer to the ques- 
tions they are asked* Each one of them chose one answer and indicated their 
degree of belief in it* This 'degree of belief is expressed in different ways 
using different verbal expressions: "there is a chance,** "maybe,** 'Very 
likely ? " "probably, 1 * etc* In daily conversations and in the news media we 
often hear verbal expressions that convey the speaker's degree of belief ih 
one or more possibilities* Dtf those words clearly express the *speaker*s de- 
gree of belief? Does the listener get' a clear picture of the speaker*s sub" 
jective feelings? Ms* Miller was told that her operation has M a good chance 1 * 
of success* What does this mean? The mechanic claimed that "the chances are 
not negligible**; what did he really mean by that? ' 

In chapter 2 we discussed the ambiguity of our dually language* There we 
were concerned with-ambiguity in the definition of uncertain situations* We 
recommended that the question or situation be defined clearly to avoid misun- 
derstandings and wrong decisions* Just as there is much ambiguity in the 
definition of uncertain situations, there is also much" ambiguity. in expres- 
sions indicating degree of belief, as can be seen in the above examples* In 
daily usage of language, the same person often uses different words to express 
the same amount of belief* Moreover, the same word is used by the same person 
to express different degrees of bfelief* (see Example 6)* 

This vagueness and ambiguity prevent comparisons among different expres- 
sions of degrees of belief* It is difficult to rank the words to determine 
which one expresses a higher'degree of belief* Tty ranking the following 
words according to^the amount of degrees of belief they express, from the 
smallest to trie highest: 

( 

¥ A good. chance, 

* Quite likely, 

*j A fighting chance, ^ 

* Probahle, 

* Rather likely, and 

* Maybe* K 

It is difficult, sometimes impossible, to build a scale out of such words* 
Is "probable** more likely than "rather likely? 1 * ' What is the meaning of "maybe** 
and fighting chance?*' Where exactly is their place in the scale? Even if 
you can build a scale*of words expressing degree of belief, a comparison be* 
tween your scale and the scales of others will show hop much disagreement , 
there if* 



9 

!RLC 



3ff 



51 



Furthermore, if we arrive at an agreed scale, we will not be able to de- 
fine exactly the relationships between tlje scale steps* How much more likely 
is "quite likely" than "rather likely?" What is half as probable as M a good 
chance? 11 Such vague expressions for decrees of belief cause much misunder- 
standing* The speaker and the listened often do not share the same meanings* 
A lortg debate can result from such ambiguities * ' 

One can claim that although the ; language is full of ambiguous expres- 
sions, we generally understand one pother quite well; moreover, it is not 
f always so important to be precise ajfrd clear* Sometimes, indeed, it would be 
ridiculous to, require such clarity* Although this is often the case, it is* 
not a justification for ambiguity in other situations* Carol in Example 3 
may be satisfied with David's answer about his possible presence at the con- 
cert, if t his presence or absence, is not going to affect her decision to go* 
But if his presence is going to^ffect her decision, his answer may be too 
vague* She does not expect him to answer with certainty (since he himself is 
uncertain) but want;s to know how uncertain he is* Are the chances high, low, 
very low? His answer conveys only uncertainty and fails to indicate his 
strength or^gree of belief*/ 

When making decisions in uncertain ^situations, the ambiguity of veAal-* 
^expressions intended to convey degree of belief makes a decision more diffi- 
cult* The lawyer's, mechanic's, and physician's answers do not help their 
clients much* Do^s the lawyer's answer, "there is a chance, 11 mean that the ^ 
chance is high enli^h to justify the money and time that will be spent in the 
judicial process? Do the mechanic's "not negligible" chances justify spending 
$200? 

' ■ r 

Vague expressions of degree of belief can (1) cause misunder- 
standings and (2) complicate the decision process and lead to un- 
wise decisions* 



In daily conversation, there are ways to overcome ambiguity in verbal 
expressions of degree of belief: We use hand gestures, facial expressions, 
and often vocal inflections* One can express the sentence "there is a chance" 
differently using different vocal inflection which will indicate either a 
small chance or a large chance (try it)* But in written language these de- 
vices will not help* , „ # M 

Another w^y to overcome ambiguity is to create a common scale of words 
in a group of people who are engaged in a .decision process* This will be, of 
course, an arbitrary scale, suitable for, and agreed to by, that specific group 
This solution may be good for some cases, but it does not solve all the prob- 
lems* An ^intelligence officer gets hourly information concerning enemy troop 
movements* /On the basis of this information, she is asjjjed to express her 
daily degree of belief in an outbreak of war* The changes in her feelings % 
from one day to another nay be very small, but those small changes may strongly 
affect a decision to mobilize the reserve forces^. Even an agreed-upon scale 
of verbal, expressions may not be sufficient to distinguish small but important 
differences in degrees of belief* 
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Another disadvantage of verbal expressions of degrees of belief is demon- 
strated in the following two examples: l A * 



1* The chances of war are equal to the ch^nce^ of rolling T a six with a 
fair die* 

2* Mr* Bakjer,has a minor medical problem that affects his daily 
only slightly, The problem caft b£ solved with a complicated operation* The 
chances for its success (removiitj|.#he problem) are equal to the chances of 
rolling a six wi.th a fair die/ s, \* 

Although the chances expressed in both examples are identical (both are 
identical to the chances of rolling a six), people do not judge this Way* 
The chances of wap will verbally be expressed as "high" or "considerable," 
while the chances of % the success of the operation will be expressed as "small" 
or "negligible*" * Why? In the judgment of degrees of belief; chances, proba- 
bilities, etc*, we tend to take into consideration*Values, gains, and losses* 
The chance of war breaking out is called "considerable" because of the high 
losses involved in it* THe same chance, in Mr* Baker's case, is judged as 
"low" since one can live a decent life with the problem and because the risks 
are high* 

For decision making under uncertainty (shall we call up reserves?), one 
has to take account o£ each possibility's chances (will they attack or not?) 
and the values, gains, and losses associated with each possibility* It is im- 
portant to convey to the 4 ec lsi° n maker a separate picture concerning the 
chances (degrees of belitf) and the values* If Ms* Miller (in Example 4) 
wants to make a decision concerning the operation, the physician should give 
her a separate evaluation of the chances of success and the pain, cost, and 
so forth* By saying "good chanqes," the physician implicitly conveys his f 
advice concerning whether or not^the operation should be performed but does 
not clearly express his belief concerning whether the operation would be a 
success* * * , 

^ For good communication between people and for good decision-making 
processes, it is important that the expression indicating degree of belief 
indicate strength* of belief only, and not an evaluation of that strength in 
the context of the decision problem* Such- an evaluation can be expressed in 
a secbnd stage after the strength of belief has*W?en clearly expressed* The 
verbal expressions for degree of belief tend to confuse those two aspects of 
an evaluation* 



t 
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Four disadvantages of using verbal expressions to express de- 
grees of belief are i * 

1* The usage and understanding of such expressions ar^ incon- 
sistent bott^ within a person ever Afferent occasions' &n4 between 
people on the same occasion* r * 

2* Anyone of these expressions conveys varying degrees of 
belief depqgpLng on the context* A - 

3. ( These expressions^ are^ihyt sufficiently stfifsit^ve to small 
hut important changes in degrees of belief* 



4* These expressions may confuse strength of belief with ex- 
pressions of value* 

^ / 



In the light of these disadvantages, we> seek a different tool to express 
oyr degree^ of belief. that will be understood unambiguously by everybody, will 
enable ^ to make comparisons between different degrees of belief » will'be* 
sensitive to small 'changes in degrees of;,belief» and will distinguish between 
the quantitative dimension (strength of belief) and the Evaluative dimension , 
(values, gains, *and losses). 

Exercises ^ 

1* Find in the newspaper at least five paragraphs in which there is a 
verbal expression of degree of belief* 

2* 4 horoscope is a way to deal witH uncertainty, thoose one horoscope 
and poi^t out words which express degree of belief* c 

3.* Rank the expressions you collected in*ex£rcises 1 and 2 £r*£i^ the ex- 
pression that indicates the^smallest degree of belief to the one that indi- 
cates the highest* Wftat are the difficulties you encounter? 

numerical Expressions of Confidence. 

What are the chances that the Boston Red, Sox will win the American League 
peknant in 1985? ' " 

* "* * , 

Jofrn: The chances are^50-50» because the Ndfe York Yankees^iblght win it, 
too* + » 7 1 *y 

Don: There is a 100% chance* 

John and Don express their degrees of belief in the possibility £hat the 
Boston Red Sox will win the American League pennant in. 19iS5** , Thfey' do not ex- 
press it in pords, but in numbers* 50 and 100* We understand exactly their 
feelings: Don is much more confident- than John*' We will adopt thei? way of 
expressing degrees of belief* \ * 
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Let, us assume that each one of us has a full store of confidence* W^en : 
a f^tt completely confident about something, when youjfeel cfer£ainty^ you v * 
11 express it by saying that you attribute yout whole store^o^conf iaenc^^ 
It', i00% of 1 it* I am completely cqnfia^t that I am r^addSg^noijV-l feel v 
rtainty regarding It, % give 100% ofjsfy confidence to^it, <$i the* other hantl. 
en we feel uncerralnty regarding a question, oyr^stpre of confidence is die-* 
ibuted among the possible answers according to our degree^bf beli&f in each* 
hn believes that it is jusj^fas. likely that the; Bostroa RdA^Sox w£j,l vin^or not 
n the pennant* He therefore' divided 100% "confidence e^Bfc^^ef^e^ ttje- .two 
ssibilitieg: ^ The Boston Red. Sox will win the'i^rj^ari ,jEe^gue ^m^ixt^ and 
e Boston Red Sox Will not win the American League pennant* * 0kC*eE*may> *£hink 
at the choices of the Boston "R^d Sox are much higher than t^osfe tire other 
amsj'he gives 70% of his confidence to the possibility ^at the Boston team 
LI Vin and pnly 30% of his confidence to the possibility tjbatjBoston will 
t win* John* Oliver/ and Don tlivi^e their store of confidence differently 
cween the two ^possibilities* ^ * ..A r< % 

Eet jis describe the total store of confidence with a circle of § constant 
ia* The division of our sfore .of confidence to all the possibilities is 
jwn with pie-shaped sectors of the circle* Don;* John, and Plifrer's answers 
i be described as shown in Bigure 3* ' " a- * ^ 
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John 
Boston will win 



Don 

I 1 ' Boston will not win 



4 '/ 



Ollqgr 

1 



» H 

Figure 3* 



Different divisions. of st6res of confidence* 



The 4ivlsio^^*"confi3^nce may^be different* from" person to-per^m, since 
rees of belief are personal, subjec t J« feelings ** ^However, XaerB is some- 
ng common to all nt&ibers: The nuwlrfmf assigned- to all' the possibilities 
up to 100* If -the confidence store \(s ltTOSLand if we divide it among ex- 
sive and exhaustive possibilities^, thai we have to use it all* The, two 
siblllties 1 that the Boston Red Sox w'lll wi£ &v that they Will not win are,, 
course, exclusive and, exhaustive possibilities, since no tie is possible* 
n one has two such possibilities', one can infer, of course', from, the 
nces , given to one possibility about the chances given to the other one* 
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The number we assign to a possibility expresses the percentage 
of our store of confidence. 



1 : ; ^ 

If the list of possibilities we elicited is exhaustive and if the pos- 
sibilities are'rautually exclusive, then the sum of the degrees of belief given 
to each possibility must add up to' 100%* If, after the distribution of num- 
bers to all possibilities, we realize that they sum up to less than 100%, then 
either (1) we attributed too Xittle of our confidence to one of the possibilr 
it;ies or (2) the list of possibilities is not exhaustive* .If the numbers sum 
up to more than 100, then either (1) we attributed W much* confidence to one 
of the possibilities or (2) the possibilities ar^ net exclusive. v 

A the following example is adapted from chapter 1; What is the longest 
river in the world," (1) the Wile, (2) the Mississippi, (3) the Amazon, ,or 
(4) other? Ray and Seu*were not sure regarding -any one of the possible an- 
swers* They divided their- stores of confidence ^differently (Figure 4),* 



Ray 




Figure 4, More divisions of stores of confidence* *=■ 

We can ej^jthat; Ray feete more uncertainty tdn Ben; Ray distributed his con- 
fidence' more'evenly among the four possibilities. » 



Exercises 

X* Consider the verbal express: 
exercises in the last section* 



Ions y3h collected for Question^ of the 



^ a* If you had to translate each phrase ^nto a number indicating per- 

centage of. confidence, what number woAld you choose? 



b* You probably are not completely sure about your numerical transr 
lation* Give an* upper and lower ljfm££ to your translation such that you will 
be nearly certain that the word it^dicates A percentage in the* given interval, 

c, iank the words accord] 
learn something about the words fron 



ig. 



to the ra n g e of the intervals Can you 
range of the intervals? 4 



.the 

Following are 'a number of possibility lists with numerical degrees, 
of belief assigned to each* But the numbers 'do not add up to. 100* For each 
list* decide- whether the list is wrong (the possibilities ere not exhaustive 
and/or not exclusive) or if the fajjlt ,is ; with the distribution of probabil- 
ities* Then correct the problegt you -fecund*, * ♦ 

a* When will they install a .new telephone in our house?, 

• Today — 10, . . 1 

• Within 3 days--40, * ' — s 

• Within a week--80, 

• " Within 2 weeks— 95, and 

• Other— 5** v ; * * 

b» What kind of car will stop to pick up those two hitchhikers? 

Ji 

• Private car or truck — 60, ^ — 

• Commerc ial - truck— 25 , 

• Tow truck— 5, 

• Taxi— 20, 

• Pus— 5, and t * 

• Other—10, 
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Where did. I first meet hifc? 



At^high school— 20, 

At college— 25, 

At "a party — 15; 

In vsy neighborhood-— 10 , and 

At a football game™ 20* * 



d» Why d£dn f t Henry call me as he promised? 

• Be f of got— 30, 

• He intentionally didi^t call — 5, , 

• The telephone was out of order — 10, 

• The telephone. was busy — 2, and - 

• Other— 30* 
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~ * e* 'Why won f t the? car st#r£? ! t 
r .... - - * 
^ • Electrical problems'-- 3<J t , ~j* 

„ . -,/",\ V-T&sad fcattery— 50, 1 . ' 

V^'but <?f gas^3Q,. v .> \ 
\ \ ' . >" Engine, flooded™20*¥tfid 



The-'iMvAntagfte »o,f Humertcay Expreg slops \ l'^ ; ' ' ^zf 

' ' V ... ! . - "r \ - * * \- 

When Ray and Bfen distributed 1$eir-£oniidence among the fotffc -^ssibili^ 
ties, wg jj fg&ied iately knew who jpas moi^e certain, id hi* chosen answer Th£ ^ 
. iiumei;ikai -language as an expression of. decrees of Sellaf has a'uffflfaSf of ad^* 
: V^tafeas o^t' Verbal' language / ' * \ v ' \" ( • 

./ . l . v • ./,-\ - * ' ' * ; , - - . - . -V' 

* \- i t lumbers oyercomeGEhe ambiguity and vagueness of verbal expressifins* c 
tfumberfc £re interpreted itedtlcally by, alljfcsers / The numljar^^^sdes a 
r percentage of all. confidence attributed to an answer or an evSnt/ Whert Joh*'" ' 
; , ( aays-Sd* t&Jb& cbancea, that tfie Boston Red'Sox will win t^e American L^tfeue % 
v/pennratf/w^'^ how he feels* He means, and we urideystand t; all of 

^th^*^;,; ■ ^ ; :\ 1 - \ ' " . y? ; ^ V^^a^ 

snce is^frti 



Ifc*'"$h2^;5p£ ''of. Ms store of ;Conf idence is(a£4:ribu^d^to the pos'sibi^t^'S 



vSv-w V;v'" ,'</ VVThat 50% of bis' confidence is attributed, to the possibility that^'ey.'^ 

^a.' 7 *- "^iat chanceS that they will win and the chances that they will not 

'*='■'' ' " - : " ' - ' '*-- ' ^ - identical', . ■ * ;: : ff 



&p.: ; : \ 7 *:'„y z^. ^tn 'are^erceived by him to be i 
,V\/ .^U -.^J^h^tV^dhn^degrees of belief ca 



can be diagrammed as shown in Figure • 




', s * 




-i. 




Figure' 6* -Division of stores 
; of confidence _ '_ 



'As can^be seen, the same number 'always expresses the same degree of 
belief* .Different degrees of belief are expressed by different numbers* 
Every number has one meaning* identical for the speaker and the listener* 

2* There Is no controversy concerning the relative strength of different* 
numbers* Fifteen percent is higher than 7% and, lower than 32%* If two possi- 
bilities are assigned 75% and 25%, then the chances given to the first are 
3 times as grjjfpt as those given to the second* Thus, numbers enable us to 
make precise comparisons among different degrees of belief* 

3* With numbers, we can express small ^dif ferepces in degrees of belief* 
Suppose that th6 intelligence officer who receives information about enemy 
troop movements, uses numbers to express, each day, her degree of belief in 
the outbreak fi'i War* , iJfcph numbers may be used in conjunction with a decision 
.rule- For e^tfmple^ the' rule may specify that if the chances are more than 10%, 
part of the re^er?es are called up; if* they are more than 20%, more of the - , 
reserves are celled U p, etc* The difference between,lO% and 20% may not be 
clearly conveyed and perceived with verbal expressions* * Often, as in this 
example, a decision maker has a threshold on the chance scale beneath which 
one action is taken and above which another action is taken* Such threshold 
^points can be a result of a long dAision analysis* A decision maker using 
such threshold points needs*^£a££ [numbers * r ^j^ 





4* With numbers it is eaSBr to differentiate bltween the quar 
dimension which reflects the strength of the degree of belief and tV 
atfve dimension reflecting the valued inherentin the decision -making, < 
The number expresses chances only; it doeq not Repress values- Axtefc^i 
'a number to express the chances, one could add aome^Krr^s-fo expresff"one"^ : 
evaluation concerning those numbers in the decision-making context* For jex^flfcs 
■ple, M a 202 chance of a surprise attack is too high 11 means, implicitly, jthftt't 
something has to be done about it* However, if the characteristics pf; ; an ± < • 
event teryi strongly to influence its probability evaluation, it may also af- 
fect the given numbers. "' ■ 



, 4 1** Numbers are understood identically by all users, 

2* Numbers allow comparisons between degrees of belief* 

3*, Numbers can convey siiJfcll differences in degrees of .belief* 

t * ■ * , 

* r . * 

t * Numbers separate the quantitative dimension of chance from 
£ the evaluative* one* 



Why Do People Use Vague Language to Convey Degrees of Belief? 

< * * * 

If you are convinced that it is much better to use numbers to T convey * 
degrees of belief than to use verbal, expressions, you prob&bly wonder why 
most of us continue to use verbal expressions in daily conversation^ In the t 
t!ews, and even in ficAdendc manuscripts* * + , 



- .Host people arenop a*&re of the problems created byv verbal expressions, 
ani, therefore do ntfFTseek alternative ways to convey degrees of belief. How- 
everv>some °f those who are^con scions of the disadvantages *of verbal expres- * 
sion refuse to us^ numbers . For most of the problems they face, people have 
a. general feeling .regarding the chaices, but find it difficult to translate 
these feelings into numbers, ^number^equires a clear specification *of the 
v feeling; Are my feelings best expressed as 20%, 30%, or maybe only 10%? 

Hot only do we find ,it difficult to translate a vague feeling into a num- 
ber, but we may believe* in addition, that using a precise number implies 
ex^tt reasons, When we say* "It's very likely," we do not feel the need to 
give a detailed justification for our statement, but we do feel thife obliga- 

- tion when we use the precision- of numbers. We expect -to be asked, "Why 60 

v instead" qf 55 or 70? How did you arrive at that number?" 

Another feeling that seems to be psychologically associated with' the 
■ use of nu&bers to express degrees of belief is the feeling of being responsi- 
ble for the result. A mechanic i&ay refuse to ^ay 80% for the chances tlfat 
the car willVorkJEor a'year without problems, thinking that if there are 
problems* he will h^ accused of a* misstatement. 

Can we' overcome these difficulties? ' 

M The Difficulty of Eliciting fftgfebers T We will propose a method for 
^licitatipn in the next sectfo'tw" - * - j . 

yhe Diffiaul£y of Justifying th^ lumbers . Slnde the numbers reflect 
stibjective degrees of belief * it is sometimes' difficult to justify them in 
- ' detail. And it. is true that sdating-a Specific number,: like 80%, makes you 

.'.'SGuniJ more committed than using a verbal pbras^ like "very likely." The very 
y >\ advantage of clarity (communicating unambi^uibi^ty with others) results £n the 
: - disadvantage of apparent precision even Whea~ymT dp nbt^feel that precise. 

■ In the next section we o^er a way of .using/numbers to express degrees of be- 
v ' ilef^.that avoids the triplication of precision 1>y giving a "range of numbers 
.iiistead of a single,^HumberC * 

- 1 : ■ '. The Fear of Being Responsible fgr the ResuXts . In the first chapter we 
\fc£lked about good decision process eS. and^des fried tesults.' We showed that 
fc*j£n good decision "process may sometimes be followed by an undesi'red outcome j 
but lii the long rua, good decision processes jriLll^more often 1 result in 
desired, Qutcomes tham wroqg decision processes will. We also argueid that one 

■innot evaluate one fc decjaion from 'its results; ojcie'has to look at many deci- 
sions. We expect a physician to -succeed lit most" operations for which she 
gave; say^ SGvE chance if success, ■bUfrve should no^ expect "hereto succeed in 
all of these operations, (ox in any particular one of them). If people, learn 
npt devaluate one decision process by its result* they may be less concerned 
about expressing degrees of belief .as numbers. t For each separate case," a num- 
ber should not obligate you any. more .than a word does. 
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Eliciting Numbers to Express Degrees of Belief 

* * 

We may overcome the difficulty In eliciting .numbers with the help of a 
Small device called a chance wheel (Figure 7)\ Tfcis circular device repre- 
sents our total store of confidence* Around the circle there are numbers 
from 0 to 100* The device Is actually com- 
posed of two Interlinked circles, one dark 
and one light* The user can manipulate the, 1 
device to change the size of the dark sector 
from 0%-to 100% dark* The numbers around, the 
circle indicate what percentage of the circle 
is dark* In the middle of the circle there is 
a pointer that we can spin* if we spin the 
pointer,, the chances that it 'will land In the * 
dark sector are the same as the proportion of 
the circle that is dark* When we say we assign 
"25 1 ' to the chances that it will rain tomorrow, 
we mean that 25% of .our stpre of confidence Is m 
assigned to the outcome "rain 11 and the remaining 
75% is assigned to the outcome 1f no rain* 1 ' These 
assignments are the same as the chances that the 
pointer, when spun, .will stop in the dark sector 
(25% chance) or the light sector 075% chance). 




Figure J. Chance 
'wheel* 



To ^illustrate the use of a chance wheel, suppose Ellen wishes to elicit 
from Arthur his degree of belief in the proposition, "In the next election 
.the present mayor of our town #111 }>e reelected* 11 

Ellen: What do you think are the chances that in the next election the 
present mayor will be reelected? 



Arthur: I have no idea* " 4 

Ellen: I am sure you have some beliefs about it* 
Arthur: Yes, I think that the changes are -small* 
Ellen: How small?^ 

Arthur: I don't know. * ^ . 

Ellen: Okay, let's find out* 1*3.1 offer you two gatnbj.es* *0ne gamble 
involves the mayor* The other involves the chance wheel* In either gamble 
you can either win $100 or lose nothing* All you have to do is tell me which 
feanible you'd rather play,, " • , * 

Step One v 

Gamble Humber 1 : After the election, we will see who the mayor 1** If 
it itf the present mayor, yoif win $100* If it is someone else, you will neither 
win nor lose anything, * 
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Gamblg Number 2 ; After the election, we Will spin the pointer on this 
chance wheel, with the wheel set at 90% dark (Figure 8)* If the pointer 
stops in the dark area, you will win $100; 
if th^ pointer stops in the light area, you 
neither win nor lose anything* , - 



* ** Which do you prefer, the first gamble, 
or the second gamble? 

Arthur; I prefer Gamble 2; I T m nearly" 
sure I will win* t * 



V "El' 

iiire?" 



Ellen; wiiat do you mean by "nearly 




25 



50 



Figure 8* Chance wheel 
set £t 90% 
dark* 



* Arthur! There*ra 90 chances out of 100 
to win* , r 

Ellen; Can I infer from this that the 
mayor's chances of reelection are smaller than 90? 

Arthur: Sure* 

Ellen! Okay* here's another choice 
between two gambles* 

Step Two* 

Gamble Number 1 ; ' After the election, we will see who the mayor is* If 
it*s the present mayor, you win $100* if it*s someone else, you will neither 
win nor lose anything* 

Gamble Number 2 : After the election, we will 
spin the pointer on the chance wheel, this time^ 
with the wheel set 10% dark (Figure 9), Now which 
of these two gambles do you prefer? * 



Arthur: On the* wheel, there's not much chance 
of winning* I'd have a better chance to win with 
the mayor; I T 11 go with Gamble 1* 

Ellen: May I infer that the mayor's chances of 
reelection are larger than 10? 

Arthur; Right* 



75 




^Ellen; 0ita?>lft's try again* 



Flgufre 9; Qhance wheel 
set at 10% 
dark * 
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Step Three 



Gamble Number I t Gamble 1 is on the mayor again* It's the same gamble 
as in the first two steps* ' 

Gamble Number 2 : Again we^use the chance wheel, this time set at 50% 
dark (Figure 10 J * Whidh one of those two 
gambles do yoji prefer* now? 

Arthur: 1^ pref4r Gamble 2* 

Ellen: May I infer that the mayor's 
chances of reelection are larger than 10 
but seller than 50? 9 

* Arthur: Sure* 




Figure HK Chance wheel 

set at 50% dark* 



Step Four * ( 

Ellen: Now which do you prefer: Gamble 1 to receive $100 if the mayor 
wins, or Gamble 2 with the chance wheel set at 25% (Figure 11)? 



Arthur: That's hard one* It's close* 
I guess I'll go for the mayor, Gamble 1* 

Ellen: So now I'm' inferring that you 
believe the chances for the mayor's reelec- 
tion are more than 25 but less, than 50* 
i 

Arthur: Yes* that's right* 



75 



u 

0 
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Step Five 



Figure 11* Chance wheel 

set at 25% dark* 



Gamble Number 1: After the election* we will see who the mayor is* 
If it's the present mayor* you will get $100* if not* you won*t win anything fc 
and you won't lose anything* \^ 
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Gamble Number 2 : * We will use the chance 
wheel again, set this time at 30% dark 
(Figure 12), 

Arthur: I have .a hard time deciding* 

Ellen: Do you have any preference at all? 
Do you care which gamble you play? 

Arthur:^ I don't know* I just can't-choose 
between them* ]| really don f t care which one I 
getV 




Ellen; So'is. it reasonable for me to say 

that the chances are that the pointer will stop figure 12: Chance* 
in the dark area of the circle are the same as the ijheel at A 

chances you give to the mayor's reelection, 30%? 30% dark* 

Arthur: Yes* 

Those five steps enable us to elicit a number which expregfie^Arthur f s 
"degree of belief* Arthur felt as if he could not express his feelinge-^itl* * 
a number, but he found he could choose between two gambles* < At the end, 
his choices conveyed to Ellen his degree of belief* This happened at the _ " > 
indifference point , when he was indifferent between the' two gambles* By 
the same device, other people could have arrived it different numbers fQr 
the same event,' s^ince their feeling might be different* Although using the—'* 
chance wheel takes time, it helps in the process of eliciting numbers* 

Moreover, it enables us to retest a number given offhand* 

* * 

It may seem that there is no relation whatsoever between an election and 
the spin of a pointer on the chance wheel* Of course, there is Ao content * 
relation between the two events* The only relajtionaLs the degrees of belief 
associated with the two events* It is easy to Rive a number to the event of } 
the pointer stopping, while it is more difficult to give a number to the second 
event* With the helpof one, we get a number for the second %vent; tfiey are 
identical numbers when we reach the indifference pQint* — > 

i - 
We will not always be willing to give a'precise number* It^is possible, 
for example, that Arthur would have stopped beforfe Step 5, saying, "I can f tf * 
say more than that the chances are between 25JJnd' SO* 1 ' Sometimes we do not 
need a precise number; an interval is good enough* ' Clarity does not call for 
a precise number* An interval is no less clear than a number* As we did not 
always require a narrow, ridiculous def inition'of the problem in the name of 
clarity (see chapter 2), we do not -always require it here when specifying * 
degrees of .belief* r 

' • *. " - f * 

Sow, after we have, elicited a number % can vr& justify it? Can we say why 

"30* or why ''between 25 and 50?" Usually we cannot justify the number or the 
interval in such a way that, from the justification we could" infer the number 
(there are some such cases, to be discussed in chapter 8), We tan just state 
the many reasons that together cause us to feel some degree of belief* ^ 



■ • \ 



It is not easy to learn a new language* We are all used to speaking in 
a vague ugrbal language when expressing degrees of belief* In daily life, 
this language se^res us quite well and £tie damage caused by its ambiguity is 
minor, but fo; important decisions it is helpful to use numbers- to express 
degrees of belief* It may be more difficult to elicit numbers „ but it is 
much more efficient* We understand 6ach other better, numerical expressions 
are more sensitive to sntiall differences in our feelings, and in the end f in 
the long-run, our decision processes will be better* 



Exercises 



chlr 



1* Try to express in a number the chances you atttribute to the event, 
"Reagan will be reelected in 1984 * M 



2* Elicit the chances for the same event from two friends, using the 
^ method presented in this chapter* Start with extreme settings of tjve chance 
-vheel and gradually narrow it down* * 9 t • N 
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'ION II: 



SOME TOOLS 



CHAPTER 5 



\ 



ESTIMATION 

Introduction * 

typical situation 'involving feelings of uncertainty is dealing with a 
quantitative problem* A few examples follow: 

• How many people will come to my party tomorrow night?* * 

• What Is the current total number of private cars In the United 
States? * 

• What Is the shortest driving distance in miles from my house to a 
specific downtown department store? \ 

• How much* will the trip- cost? s 

• How many copies of James Mlchener's most recent novel trill be sold 
+ thl^ year? 

• 'How long is the Nile? * 

. Host of us feel uncertain concerning such questions* We are aware of 
the fact that we do not have fhe correct answer* namely* the exact number * 
These feelings of ^uncertainty can be either personal or general (see chapter 
1)* They are personal^if we feel that this is "out problem"; the number 
could be found in some reference book (encyclopedia* statistical report* 
etc*) or there are people who know it (for example, some officialsin the 
Department of Transportation know* the total number of private cars in the 
United States)* Maybe even we personally could have found out the exact 4 
number* provided that we have had enough time (like measuring the distance 
* from our house to 'the downtown department store)* On the other hand* some- 
ti,TffiffS^Ofir feelings of uncertainty are^ general: nobody can be sure,, for ex- 
ample, how many people will attend your party tomorrow* er what the e^act 
population of Babylon was 3*000 years ago* rf 

'In the previoutTchapters we presented several stages for dealing with 
questions about. which we feeltuncertain: (!) Check whether the question is 
^tlearly formulated; (2) list different possible answers to it; and (3) assign 
different numbers to the answers describing out:, different degrees of belief* 
In such a wap* we answer a question and at the same time express the amount 
of uncertainty that we fgel toward it* : * - * 

* • * f 

Similar rules apply to quantitative problems* where we are**frequently 
in^toted for practical purposes in getting either a single number » which 
seemsxljjjis the closest to qj^e true number, or a range of numbers * rather 
than develtaing a classification of ^possibilities and their chances* When 
reporters* r^: instance, cover a demonstration* they want to report one num- f 
ber (e*g** approximately 8,000 people) or one cl&s? (e*g** between 8*000 and 
10*000 people)* These reporters know that the chance of their' estimated 
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number being the exact , true number is almost zero* However* a good -approxi- 
mation illustrates the scale q$ the demonstration; it was not a small one in 
Which only a couple of hundred took part* nor was it a huge one in wh^ch tens 
of thousands of people were marching in the streets* \ v 

Quite often when we have to assess quantities we feel that we do not have 
the faintest idea regarding the problem* We feel unable even to tell the 
appropriate order or magnitude! hundreds, thousands, tens of thousands? 
Returning to the demonstration example, the street In front of the city hall 
was full of people participating Ih the protest. How many were there? It 
seems as if there is no Information available that could enable us to know the 
size of the crowd* However, if we think a little bit more about the demon- 
stration example and similar problems, by utilizing some methods which/tfill be 
presented later on in this chapter, we realize that in most cases we do have 
some partial or fragmentary information atr our disposal, and it" can enable us 
to. make some assessment or evaluation . Although it is merely an approximation, 
it. should, in many cases, suffice* 

' The difficulties we face when assessing such problems are in three areas: 
(l) We hate : to recognize the fact that we have considerable amounts of partial 
information* concerning many questions; (2) We need to reveal the appropriate 
partial information, and to check its relation to the problem under discussion; 
and (3) Finally, we need to organize the information in such ^ way that^we can 
utilize it well and eventually reach a good assessment* 



infsjarifat: 



In this chapter we will study methods of identifying partial infQjafiation 
and deriving a numerical assessment from it* 

What Is an Estimate? 

' * 

A young novelist who has published some hooks in the past sent a manu- 
script of /a new novel to a publishing house* The publishers read the manu- 
script and agreed to publish it* How they haye to decide how many copiea they 
should print in the first edition * They cannot be certain exactly how many 
copies of the first edition will 4 be sold* However, they certainly cannot 
claim to have no idea because they have some information that may help them 
assess approximately how many copies will be sold, namely, the televant order 
of magnitude i * * % 

1* The publishers have read the manuscript and know what it is about 
(for instance, this novel describes one of the old families of £he South; 
within thi& framework a love story is told) . they know generally how many 
copies of similar novels have been sold in £he past* / 

2.* They axe acquainted with the previous books by this novelist and 
know how many copies have spld * 

3* They know how many copies of a "best seller" are sold, and th£y be- 
lieve the new novel will not be a best seller* < 

After the publishers gather and organise all these pieces of information, 
they will be able to assess the number of copies for printing purposes* 
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The procedure for making a nmoe'rjLcal assessment based on 
partial information is called an estimation procedure . 



The estimation procedure contains two distinct stages: 

1* Collect relevant information on the current problem* ** 

; * 

j 

* \ ' - 

• Books about old families in the South have in the past pold 
about 8,000 copies th£ first y^ar* 

The novelist f s former books have sold on average 2,500 Copies 
a year* 

i I 

* 

• A best seller usually sells mose than 20,000 copies a year* 

2* Assemble in some way all these fragments of information to obtain an 
estimate * 



; * 

The number obtained by the estimation procedure is called an 
estimate* 



Exercises 



r' 



,1, Following is a list of professions* Give some examples of estimation 
roblems that these people have to solve in connection with the i? daily jjork* 



J • Plumber > y 

^ • Carpentetf, * 



• Truck driver, 

• Construction worker, 

• Tourist guide, 

• Dressmaker > t ^ 

• Film producer, 

• Housekeeper, and 

' • Intelligence officer* - % 

2* Describe five cases in which you have made estimates* 



Searching for Relevant Information 

Joint's* exam will take place 2 weeks from today* John, is wondering how 
many days before the exam be should r start preparing for it* Does he have 
any relevant information that may help him to decide when to start studying? 
Certainly this will not be his*- first exam; he knows approximately how many 
dqys he has spent for preparation in the past for exams of a similar scale and 
importance* He remembers also whether the preparation time was usually enough 
or whether sometimes he had the feeling that he* still needed more time'fco 
cover all the material* or conversely, whether he *f elt that he had started 
preparing for the exam so early that by the time of the exam he had forgotten 
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le vital details, In sum, his personal experience with similar exams is 
finitely relevant information that he can use to obtain the desired 
tessmpnt* , * ' . % ' ^ 

A couple <|fcfefctudents decided to earn some money by selling soft drinks 

people xelefiEating the coming Fourth of July* How, many bottles should 

ty buy?*" They do not have personal experience, but they have several alter- 

-ive^ sources fdr collecting relevant Information: 
* * ** 

\ # \ 

1* In the city celiter there are booths that regularly sell ^drinks and 

reshments* The owners of these booths may furnish information concerning 

.es of cold drinks on regular weekdays an<i weekends* \ 

2\ Perhaps somfe\o'f the^>ooths\sold drinks last Fourth of July and . 
ty may remember the- Quantities sold then* < \ t * « 

3, ^Our students can,ask themselves and others how j^any. bottles of. 
d* drlnka a petson who stays* in the streets at this timl^of year will nor- 
ly consume* ' A 



posal' and those we successfully colL 



• Pieces of informatiptuat our'disposal and those we successfully collect 
' basic data to use* in estimation Therefore, it is important that. they be 
accurate as possible* It is sometimes hard to ensure. that all pieces of 
ormation will be accurate; 'We normally prefer/to u^e a* piece of informa- 
n in which we are more confident than another piece that we trust les£, 
n though the latter may seem tQ us to contribute more to the final est^mat 

For most of the quantitative problems .that we face in, our daily lives 
do not have accurate information; thus we cannot soitre thenv^eelihg ab- 
utely confident in'our solution* .Nevertheless,, we almost always have s&ne 
tial information that can help us obtain an assessment* Whil£ thinking 
ut £hese problems* for the f^rst time, we do not always realize we have 
h informatioh (for instance, we ; have no, idea*how many bottles of so;£t 
nk were sold last Fourth of July)* But further tiliinl&hg in, other direc-^_ 
ns will reveal partial information that,may help us in our assessment * 
cess* We may think, for ins£gpce N of the average quantity of bottles con- 
ed by somebody who'staj^ out ^11 day" in hot weather* ' y 



' ; — : ; a r 1 * — J— 

\, ^ It is Highly important v(l>* to seek relevant information 

actively ajid persistently and (2) .to pursue it in different r 

^channels arid directions*'* > A 
* , , — — . , 2- 



We can seek ^information by consulting source books 6r* experts and by 
n^ing hard enough to* reveal what, partial information we already know* 
a if ttfiere is not'enough time* to consult outside sources oj: experts, it 
pTrely the case that we find; aiiter some thought, that we have no partial 
ormation; ^ , ' , " $ 

* * 9 f * 

* * *How many .tons of apples were picked last year .in Oregqn orchards? 
• What is the weight of the,White Hous^? * \ 

What is the total length of 'all the* blood-vessels in otft body? 



For these and similar questions we hay6 to admit' that* we have no Idea at all, 
but we should no± oje^use such claims of ' lack of knowledge; usually we can 
think of some w*^f approaching the estimate* , 

Processing Part He Information — The Assessment Procedure 

The rele^atft Information furnishes us with basic data* How can we make 
use of such Information? How can we process It to reach a numerical estimate? 
There a?e several methods for doing this* These methods differ In the thought 
processes involved, Following are several Illustrations; 

* 

Example A : The organizing committee of the coming convention of Korean * 
War veterans wiahes to know the number of people who will attend the convention 
next^year. This ifefpraaticin is Important to the organizers, for they have to 
order adequate facilities, parking, food, programs, etc* How can the members ■ 
of the committee estimate this number? They decide that they will base their 
estimate on the number of participants at the last convention, which was hfejd 
5 years ago* This information serves as a starting point to use in construct- 
^ing the estimate* They consider in what respectfe the coming convention will be 
different from the last one* Tor example^ the season CsummeiJ versus fall), 
publicity^ celebrities and entertainers who are expected tCar^ive, etc* 
Based on such partial information the -committee decides that 25% more people 
will attend thik year th^n attended the last convention* * * * 

In this- example, the, t committee fchose as ids starting point a number that 
they knew accurately* Often, however, the starting point is itself an estimate, 
which is th^n adjusted according to the specific conditions of the problem* 
The choice of a* starting point depends, in part upon which aspect of the prob- 
lem is known with the greatest accuracy* Ii) our example, had not^the orga- 
nizers of the convention^ known how many people attended the lasts- convention, 
they might have chosen Another starting point, perhaps the total number of' 
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members pi the organ izajjpB* * 



One of the methods for estimation is to begin with a starting 
point and to # modify it according to the specific conditions of the 
problem under discussion* \ c- * 



* 1 

Example B f A platoon commancfe* in the Air Force was' ordered to pre- 
pare an aifstrig for emergency uae so that light airplanes coujd land and T 
take off from it* He had to* notify his superiors'how much time he would neea # 
for this taSfc'or, in our terminology, he was' supposed to estimate the duration 
of the operation* ' , \ * ¥ 

The coramander^fcwho personally had never before directed such an operation, 
recalled that the longest auration for a similar operation was a # jEull month* 
That operation was directed^by one jof hia friends, who yas scolded by his 
superiors for taking much 'fettto long* 

- 7 ;■ , ' ... -r i 

On the other handy Gun platoon commander remembered hearing that such an 
operation was completed by a platoon in 3 days during wartfimeT Therefore, he 

beloved that his assignment would take between '3 days and 30 days* 

^* 
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Now he considers the ^jJecific condition^; t ' r $fye pla r topn is on p£ac£tims 
status; there is no neejfror exceptionally speedy, action* But it Is summer , 
now, and the area is generally flat, *so % tlie" operation can^be ^arri^d out ^uits 
quickly* Bearing all These data in mind, the contfoaiyier cab e^tlm^te how t tnany 
days, more or less, he will need for executffcng/tliis order* f * * / ■ 

Example C : , What is the aeriat-dista^;J)^)^ea ^ FrancistQ an^V , ' 
Wichita? It is definitely less than the di^iro^f XQ% 'San FranciiCo^o, Ketf fY 
York, but ceH^inly more than the distance f^in^afe^ancigco, te-SalO^ke V' 
City, * ^ " , f f / 

If we have estimates for the distances to J^*W^i^ f S^ l^eM City, V ,/ 
we have a range of numbers within whicb^the desired esti^t^ Will b&+,, w4 can , r 
shrink this range further by se^kipg more informatl^ X^^ifBta^s w$ teflike we 
know the distance between San Frai^pco and Cfeic^go* ^d/Ais tiiaj s^tve us as, 
a mare suitable upper limit, less Streme than New York) v, ; ' ~ 7>s 

I ' 
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Another procedure is to select, twer extreme V#lu«£ * "* Within, 
thes^two boundaries* considering the specific conditions, esf in- 
mate tfee desired number* ' % 1 ; - * c 



\ Thef extreme tf^Kl^s in: this second kind of pro<Wure can also ^fik^fe.a^ 
the~endpoints of classes of possibilities, whfmeve£ W€t w a wa&£ to^^ons.trnuct l*ueh 
classes' gather than using a single, estimate*, . In contract, in ^e .first pro-*-^ 
cedure we try fo identify the mast plausible class joV.^yeh a certain titfflfre3r L 
within that class* In this respect, the twqr proc^duttes are Wsentially ^ 
different* * * ^ . ^SV^./^~> v 

-Example P ; ,TWo foreign correspondents, J^ack And Susan, are tof enfitg ' J 
an IDF (Israeli Befen^a Forces) parade* They get.to^ndeifi^JWw mAhy jwoment *" 
soldier^ Servfe In" the I$F* * , ' \ -""</"> ■ * """" 

- Ja^k:, What do yot* thipk the-iiutiif^i* is?~ '-■ ' . . ■ V- 0^>' " 



-Stisan; How. copld.I know? That^ classi£±^d r# ±i^brflia|iio^* " 

1 J66k: I f d^ lik^ to write sai article' abou^'t^e^^iioi^,.^!^^ 
iiet f s trjr.to es£im^te how many tharje.are* - "- : ^^'^i'*"-^ 



Susaits./Horf can, you .figure it obt?' 4 ^ ■ 

\Jab^ ft, se^ms to^ me qujtte s4mple* The^t are some 3 milliotr*-ilOTS* in m 
Israel. *T&ffi*oi .^hem^ are female, so there, are about 1*5 million * Jewish *wogen " . 
in Israel*^7the average liie expectancy ^or women Is afybut 70 y^ars*' In evefy - ^ 
age group tmevjk are, therefor^*, # approxlmateflLy 20,pOQ TOmen^..because,l*5 ^41* ' 
lion divided by 70 is^rdand 20,000 (assuming, of ^outfte, . tlife>saEDie tui^ber*>f , 
women Un fiach age grpup) * y Regular ipii^tary ser^^^iasts ^or^years* , TSuis, \ 
at any ^Iven point in time, there, are. abouf 40,^09 wow^.^ldlerfei^^the ^P°V* * 
in two age groups, 18-19: and- 19-^0* '/ /' */ " ' ^>\-*->">^/ 



Sufean; tfait a ^iltittteJ you don't mean that^ all;,ttie.womenaged; 18 or 19 
serve in the* army? This pamber seems to mf -.exaggerated', 
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Jack: Okay, I'll deduct from my estimates quarter of th£;vqmen, who do 
/not Serve JEor various' reasons* therefore/ my final estimate ip afcout 30*000 
. r vomen soldiers in the Israeli army* . . 

■ " ^ Example E : A tourist and a resident of Los Angeles are taking* 

■ ■ • - * 

* Tourilfc: I envy you* The weather in Lojb Angeles is splendid,' it hardly 
ever raija£\ere, In London it rains almost, every day £he year around* 

Resident: Although fre do not have ae itfnich rain as you haye iji London, * 
'tHere 'are plenty of rainy -days in Los Angeles during the year* 

Tourist: What are you talking about? I bet there are no more than^ 
v r 'rainy days during/ the entire year* ' 



ii )f 



' \ Resident: tet^s agree that a rainy t day means at least 0*01 inch erf rain 

during the 24-hour period* It rains, in Los Angeles only from October until 
April** Rain^in "other months is veffi rare, so we can ignore that period* 

t There are 7 months of rain, and w8& let's break it down: (1) in October 

and 1a April there are few rainy days, say, about 3 days a month; (2) in, the * 
other foonths, too, not every day is rainy* Let's suppose that in each on^ of 
these months, there are S rainy days on the average* So from November until - 
, March we have some 25 (S multiplied by S) rainy days* In sum, there are about 

J31*rainy days during the year in Los Angeles. Obviously, if the year is 
either very rainy or unusually dry, our estimate will change* 
* 

Tourist: I am still envious* If I do the same calculation for London 
weatii^r, I believe £he figure will be atound 150 rainy days a year * . 

Examples D and E illustrate a procedure whereby^an estimate is constructed 
from partial or .even full information about related events* Sqjaetimes it is 1 
.. / eas^ey^ to begin/with the whole-, or with a large number (like the entifce Israeli 




'.'figure oud\t^/^hole v ptf&S&x%$ number J&at we Ere trying \tp estimate (thg. , /r //J** 
Zot&t swot rainy 'dWxs/iuha/jtypical year)* ; / * '/ ■*/ ->;/i'j 7?f: <{?'t~ 

1 ThAe two methods ire usually Called decpppositlonjanjd, r Bco^og^fe^ / / 71 



, / ' /^Tsin« ' t he j&etftod^f dejgoapo^jltion^ wte s^arfc " with <^oia? * 



esJtlmate au'^ By p^SmptitotiS^S^tSS the ^esl^eed! ^ompqfteiit^ / . 
/and by, a^utatipT^ fp^^ne fheta; tQ' g^t ttte. iJ^^gd^hole* s |. ^ ; 1% 
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1* ■ These methods are not totally different^ so we will" not always be 
able to state * clearly that we .utilized one of the four methods* Possibly ou£ 
specific method will be a mixture of two or more of them* 



■) • * 



2* lit is often ajjfood Idea to apply two' or wore methods, , v \ 

3* When you deal with estimates, you will fcerrainLy find additional*. ^ 
methods that were not mentioned here* The type oVproblem and kind of infor- 
mation available to you will lead you to an appropriate method* Thus the . 
word "methods* 1 is perhaps too'formal; ttiese methods should bfe us^d merely asy 
recommendations ♦ ' - ^ \ . * , - 

Although the methods 'discussed differ, they share something in~commort: 
The estimate is based on a detailed and explicit procedure , ^ -The partial in- 
formation is specified and so are ,the.ways by which It is processed* * These ** 
methods differ from the tomaon prattled jof estimating and assessing **offhand**' 
without thinking about the available partial information nor the Vest way to 
utllize.it* v ' - " * 

* Advantages of "Detailed gnd Explicit Estimation Procedures 

Detailed and explicit {procedures as £e scribed in the previous 1 section 
will probably produce better estimates. Hie estimates will usually be 'closer 
to the true number thad will vague and inexplicit estimates for the following 
Reasons: ^ • ; J - , _ - \ 

1 T Whetpwe specify the details, we spend more tine thinking about the 
various aspect^ of thfe problem^^ 

t V&* The details enable us to examine the. £xte6t to which we are familiai: 
with the data needed for solving ^he problem, hd*r mu$b of^the desired infor7 . 
| matron tfe already have,*"*and what we stili need* In *thi& way we have some* 
■criteria to judge the reliability <?£ the estimate we prod^fee-* 

3*; The details help revea^ thosg items a£out which we h£ve cpnsiderable t 
'amounts of informtiop ^nd therefore can vlb& In, the estimation_pr<^pedure* Fot 
examp.le v we have laqre Stodwledge about the jipmber of " rainy day$\in.our area eacji 
month* than.aboy^ th^/tAtai number the^rear around* This 4 s J*Y * n attempt t& 
..,.£$ckl* the pjobiem as ,a "whole (total number of rainy, days^amiuklly) will pxob- 
,Vf&LyVtesult\ln,~lM&^^ than those, produafid l>y loofefh^k^ ^ 

details on wljitftuwe^ iiwz&. n«>/eV^wledge .{numbei: of; raitt^ days eai^h irailh) . 

4*, Ah ad.ditio^X/^v^ntege to r^chittg^ali^e&timate by i de^aile^atid r 
B^plicit way overeat* offhaitjti estimate jts'that the former is more : <frear*to * 
, /sQ^ntiny and cidticisia than the latter* The,. average number of rainy days edch 
^mbjatfi; the constancy ^af -this dumber across several mpn^jhs, the month^with tb^ 
^,T)$gti§st precipitation, these loatters and Siipila^ ones ,ajr£, debatable aiid^ ojjen 
;^JTA ipi^Ut^ny* ^Thi(i9 we v £a» exatfctne th& basifil for di^erent^stii^ateB of the^ ^ 
w '[^ip^^.iodtfil aumbetf of^rg^qy days in Los Arigele*/ Without guch datail,. ^fig * 

jswre difficult to ^ba&for to^eck rf^f i^LaJ.. est;&a$e *(as When, th.e tourist v % 
][ in Exkni^le E estlm^t^d 6^1y S*rainy wfB*£ year}* Similarly T teaqhera of 
. m^tfwmatics ^usmt^y, m*e v fer fully described soipSion* ov^r Solutions that give 



only*the answer* The Retailed procedure can be scrutinized #nd corrected much 
mor*j efficiently than pan the, fin$l^numerical result* 

\i - \ " " . ' ■ 

EsSSicises * - 



f * 

* 1* Suggest one way^tQ- obtain each of the following estimates using 
the methods of decomposition or decomposition* ' Describe the various components ' 
^in detail, but do hot make any numerical computations* * « . 

T * 

a* How many tfooms are there itt the Plaza Hotel in New<York? 

b* What was the^xtal number of touchdowns scored by tjie University 
of Ulchigan fotffball teagi^fa^t season? ^ 

> k c* How many vcftrds, (including repeats) are there in the Bible? 

d* tfhat4s tKe total ntober cff J.ef t-handed people nationwide? 

* e, /If -all Ohio f s 'residents ,sfcood «Ade by side hplding hands, wbuld 
they ^ufcee^a in encompassing the state f s borders? x . ' - * 

k^'iC)fcest lab checjEu? the reliability of various commercial products*. 
The 'testing* method is illustrated by the following exampl'e: If 4he lab is 
requested to approve 'the durability of a certain cloth, say* over 100 yashings, 
it will ate tuajly wash a sample of this cloth 100 times and check any deterio- 0 
rafctsA-ef quality* Now, *for the foll^owing commercial products, please esti- 
mate the numberyof actionsr^fof? instance, things) that the t*st/iab will * 
have to carry y6ut* in .order to Rfove th? durability over 5 years x)f use* 

a* Prod ucts^qt ended ^for use in a house, occupied by four persons: 

1 * * • A ^rqnt door key — a single testing acti<^iwill*be H one locking 

^ * and one tinlocfelrrg,. 1 A ' * * * > 

" * / • A lav^ktpry .flushing system, * 

* • An electric Mght for a kitchen stove, and * 

• ' * ' * • ■ , ' **• 

• An electric wall switch ♦ - ^ 

\ - r ,; , - * " • # 

*j b+ A ballpoint pen in ose by a high school student (testing criterion 

wovld be the length in feet r of continuous tfrfttea line)* * * V 

c* A ^mall .pump for bike t'&res, ( 

1 i * * 

3* Estimate numerically som? aspects of modern living,: 

a* Bo^many films have you watched in yrfur life? t ^ , 

■ . * ■ r * 

In. How myc^i^Mne^^does an average smoker ^spend for cigarettes during ; 
a lifetime? ' - ^ ' * - £ v , 
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c. What is the total number of hours an average college'student , 
llts lp'the classroom before graduation? 

<l|* How many steps do you take when walking from the. parking lot to 
your desft? , * - 

e* *tfhat Is the total number of eggs you have consigned so far? ^ 

Checking the Estimate " % * , 

Checking the estimate Is an important part of the estimation procedure* 
It Is customary to dif ferepiiate between two kinds- of check; preliminary and 
detailed,*- 

Preliminary Checks * We will check whether the estimate is plausible* 
Por Instance, imagine a candidate becoming excited In br election campaign 
and exclaiming* "Thirty million pan are unemplbyed * The objective of making 
the preliminary check ^Ls t5 see whether this figure seems plausible* "If there 
are about 1*5 million men in each age group in the United States, then there 
are ^bout 75 million men between the ages of 20 and 70 (see Example D above, 
about* Israeli women 'soldiers) ♦ It is absurd to suppose,that almost half of 
them are unemployed,* * ^ 

Detailed Checks * This* form pf checking is more detailed than the former 
in that we are not content with questioning the*reasoriableness of a given 
estimate but actually make new estimates in one or more different ways*' Then, 
we compare the new estimate or estimates with the original* If the original 
estimate seems to us to be unreasonable, we QaH now -reach a, more plausible one, 

' * The estimation "procedure/ is based, as was mentioned before, on partial 
information and logic* The amount of partial information concerning 4% given 
problem. differs between {te^f/le* Somebody knows more and some 'others know less 
about ^Ijb problem* Somebody may be familiar with one aspect, while his or her 
friend is more acquainted with another aspect, and a third person may be 
familiar -with more than one aspect of thematter* * Various aspects of the 

problem, therefore, help the per sop or persons involved to carry on the esti- 
mation .procedure in different ways* 

.The following^ Is an illustration of a detailed chedc: „ - 

1 * * j 

* r J 

The city engineer Is masked to estimate how long it will £ake to perform 
some base construction work on a specific road* Bet superiors want to fcnow 
in advance how long tfi& road will be closed to traffic* The engineer is try- 
ing to recall how long "it usually takes to do the game work and accordingly 
reaches ad*'estimate (here she utilized the f lr A^-egtimation procedure: t starts 
ing'from some base and modifying it). The engineer knows this is only an ^ 
estimate and an error might have occurred (an error is likely when dealing 
Xf%£h kiry Estimate)** Tbfe important .tiring Is thatjthg ,errqfr ,sl\puld, r nqt be too 
large* t Accordingly/ she checks herself by estimating the same figure differ- 1 
enfcly v - She Estimates, th& average time duration of each stage of the whole 
job a&d then combines all the*estilaa£e$ (recomposltion) * Computing the esti- 
mates in different ways majr reveal bia'ses and errors* If the two estimates 



itr... v • ' 75 , 



* 



are similar, it is* likely that the error is small* However, if they are very 
, different, it may mean that one of them or both ,t>f them are'higfrly bissedj 
the engineer should review all the stages of estimation to see where the prob- 
lem mi ght lie* 

Preliminary checking and Retailed checking can be closely related* For 
'example, having decided quickly that there canno.t be as'many as 30 million 
unemployed men, we can use the same framework tov arrive at a new, more de- 
tailed estimate; There are about 75 milIion*men between the ages of 20 and 
70; if about 10% of them- are unemployed, then there are about 7*5 ^million un- 
employed men* An estimator more knowledgeable about such demographics would 
make >an even *uore detailed estimate that includes teenagers with their much 
higher rates of unemployment* and so forth* 

r ' 

Each kind of checking caji be either Personal — the estimator checks his 
or her own estimate^-or in ter personal- - the estimate is checked by someone 
else* The city engineer mentioned ^bove made a personal cjieck by recomputing 
her original estimate using £ different method* This would have been done, 
of course, as an interpersonal check by another person* * * 

• * * , 

„To the greatest extent possible, we should try to avoid letting our 
estimate depend on the estimation procedure* There is slwsys one true value 
th^t we are trying to estimate* We wisH to obtain more or less similar esti- 
mates (that is, practically one estimate) ol^this value by making use of dif- 
ferent methods for computing these estimates** 

* 

In this chapter, we realize the close connection between uncertainty ' 
(which was discussed in chapter 1) and partial knowledges For most of the 
daily problems we solve, we have only partial, father than full, knowledge* 
That is why we feel uncertain when dealing with these problems* We have 
illustrated that there are more- and less-clever routes fpr utilizing tfie 
partial information available* 4 

r We have stressed, as we did in the first chapter, tnat clevet estimation 
procedures cannot .guarantee correct answers* However, the importance of esti*- 
mat ion-procedures lies in increasing the chances of a value that is close to • 

the true one* * 

* y > 

* 

E^erciseq ^ * . - ' 

* r* Perform preliminary checks on the following estimates; are the 
estimates plausible? 

• In 1 Hungary there are 450 public telephones* 

> 

• It takes a steamship 80 days to circle the .globe* 

9 • One million copied of Che New York Times are printed every day* 

m r * > i 

•" ' • • There are 100 Industrial accidents in New York .City each yean 

*' * ' 

• If all Pennsylvania's residents stood one on top of the other, 

the Tine would reach the moon. 
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2* F05 the following questions, try to reach an estimate in two differ- 
ent ways* Are your two estimates close? If not, Improve' one or bojth of them* 

What is the total number of babies bom each day in your state? 

• What is the total annual mileage of all the motorized vehicles 
in your state? 

v * Hpw'lnany books have been published in the world this year (includ- 
ing additional printings of all books)? 

* How many churches are there in the United States? 



T 
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CHAPTER 6 

£ ' SAMPLING: * P/&T I 

Introduction 



nJ The Sew, York Times , December 20, 1984 
Hev Show Big Big* ' / 



* The new TV' show, "M*A*S*H in World War III/ 1 Is proving to t 
*be more poppl^r than expected* A public opinion survey of*2,000 
resjfondents revealed by fche' network today showed that 60Jt Hf 
those surveyed reported knowing of andlikipg the, program* 



Kathetine; It's no wonder that most of the country Hikes "this 'program- 
I 'think It's good, too* t * m 

* 

A Wifliam; Who says that ipost Americans like this progi^am? " The news ' 

story says only 2,000 people participated fa the survey* * Should .1 remind you 
•^hatf the total population is over 4 200 million? < ^ ' 

,* This news item introduces an additional method to reach' an estimate 
. based on partial information* Here, partial Information is obtained from a 

sample that is only a portion of £he population that Interests us* The sakple 
-» is the source of the Information/ \ -^s. ^ 

V ^ Nob<*ly c^n be absolutely confident that ^xaCtly §0% of the entire popula - 
tion (about 210 pillion people), Ilfce that program, ^However / 60JE of the 2,000 
respondents is certainly an estimate of the percentage of those who like the 
m program in tlje entire population* We do not have full Information about the 
opinion of all the 210 million, because they were not asked* the Information 
concerning these 2,000 tiho were asked is partial » and majr serve $s an estimate 
for the population as a 'whole* 

We frequently hear about estimates based on samples; 

t 4 1* Many public opinion polls/are ^eld before elections, In an attempt 
to estimate the voting results, VSutth a poll is based on small, samples of 
voters who are asked about their voting Intentions* The elAion results 
are then fnf^rrfed from the results of thp poll 4 , * p ' 

t 2 % When frime magazj^ne is interested in knowing the opinion of thJJpufclic 
on iSew econffluit policies, . for instance, it sponsors a survey of a sfcifiple of 
phe public and t^pn regies on the Estimate obtained by the survey results* 

3* Testing laba that check the question of new commercing products 
usually 'conduct tests on samples /of .the products; the results serve* as an 
estimate of thef quality of the product in general, 

ft* - / -> * 
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Also, we ourselves oft^n experience making estimates ba'sed on samples: 

1. 'Mary:. Did yoii ^ee that bus driver? He Is so discourteous. He 
closes the bus doors before the last passenger touches the ground,, and he 
does not reply politely' N ttZk passengers 1 questions* - 

x * Jane: He Is not the only one* Yesterday I had a similar experleije 
with 'anether bus driver* 



Mary: Bus drivers In this »clty are so rude 



2* Laurie: Look* Bob* what a' beautiful display window* Aren't those 
clothes beautiful? 

w * Bob: Yeah, Let T s go In; this store sells-%reat things*** ♦ 
3* Tom: Dan, I T m going to see "Black Storm*' 1 t Do you want to come with' 



me? 



Danr Who told you that 'film Is *any good? 



\ : 



Tom: I saw a small bit of It In a preview** It was fascinating* 
I assume the entire film is like that* \ 7 

In all these cases, evaluation was made on the basis of partial Informa- 
tion* "This Information was obtained from a sample: 

1* Mary and Jane assume all city bus drivers are rude by. observing only 
two of them* For Jane and Maryf these two bus drivers constitute a sample 
representing all the others* ' ' , 

2* Laurie and Bob believe the store sells attractive clothes jus't by 
observing Its display window* The displayed merchandise serves as a sample 
of thfe entire ifrfock in the store* * 
± ■* 

3* 'Tonf'tiecldes that the film is Interesting because he was fascinated 
by the portion he watched* 

* Even this small list of examples shows 'that in some instances It Is 
justified to Infer ^from a sample of Items to the whole set from which. It was 
originally sampled* However* In other cases, such Inferences are not justi- 
fied* There are samples that look "good" and reliable; others seem "bad* 1 ' 

'In this chapter we will learn something about samples* In order to know when 
we can trust an estimate based on them* *< Nevertheless, we. should keep In mind 
that although the sample may be good and reliable, the Information derived 
from it is partial «and no more than an estimate* As in any other situation 
involving uncertainty* we cannot- be stire what the true situation is* Unless 
we cheese the whole relevant group, we will remain, to some extfent, uncertain, 

' even with the best of samples* * 
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Fopulation-and Sample 

A major city is considering repaving a road often used by trucks to bypass 
t?he city* To determine how thick the new paving shoujd be, the city planning 
office is interested in finding^out what proportion of all the traffic on this 
road during the year is trucks. How can such an investigation be conducted? 
Obviously, the city.. will not hire a group of people to watch, the highways 
whole year, 24 hours a day, and count all vehicles driven on it. Such a pro- 
cedure woul<i consume an excess of time, funds, and personnel. Instead, a 
sa&pling procedure is used* 

* 

A certain short period is selected, during which all vehicles on the 
road, trucks as well as other vehicles, are counted. In such a way, we get * 
a partial group of the total number of vehicles using the road* The percent- 
age of trucks in this group is computed, and this percentage serves as an 
estimate for the same percentage in the total group* — 

, 

Which partial group should be chosen? There are several alternatives: 

/ 1* The city could decide to count the vehicles during a single day in 
that year* Thus the 'percentage of trucks in that day will be the estimate 
for the annual percentage* . , 

2, It is possibly to choose 1 day egch month , so s the partial group 
will be all vehicles on the road on these 12 days, 

3* All vehicles on the road during 1 week could serve as a partial 
group* ' * 

4* -Still another period for counting the vehicles could J>e 1 hour 
^pvery.day in the year , * 

Each one of these fend other) partial groups is a sample of the larger 
group of vehicles using the road throughout the year* This large group, of 
which the percentage of trucks is our objective, is called the population * 



The population is the stun total of items ony&iich we vaaf^ 
%o obtain information, 

A sample is a partial group of items selected from the 
population* 

Sampling "is the procedure of select^Mi| a sample from the — 
population* 




Not all populations are people. You can say the population of VW Rabbits,, 
or the population of, all bottles in a food store, as well as the population af 
our town. — 

/ ' lN» - 
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As^W^have seen, various partial groups, that is, various samples, ca$ be 
selected* Figure 13 illustrates three different samples drawn from the same 
population* ^ There are, of cou*£e, many different samples, varying in size of 
sample or observed features, that could be ttawn from this population* 
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figure 13* Three samples from one population. 
Figure 13 demonstrates several features; < 



1* Every item in the sample is part^c^the. relevant population* * , 

2* Not every item of the population is. included in !§fr ^mp*£*^nless 
the entire population is Included, and in such a rare case,' it , is no longer 
called^ a sample*)* Tt^is, a sample is' always a subgroup of £tie relevant 
population* % * * 

3* There are many ways, to draw 
can differ in composition '(different 
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from a population* 'The sdmples 
and incize (number of "items). 
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As far as the population ±s concerned, the information derived from a 
sample is always partial and serves as an estimate of a certain quantity of 
the {copulation ♦ The percentage of trucks among al\ vehicles driven on the ' 
road during a single day is used as an estimate of the annual percentage; the 
percentage of people interested in a TV program, assessed in a sampje of 2,000 
respondents, serves as an estimate of the percentage of the entire population" 
of TV watchers* * - * 



"Exercises 
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Go back to the exercises in chaptgr 5* Select five estimation problems 
for ffhich a sample would be helpful, ^no^plan a sampling procedure* Answer 
* the following questions for each: . ' 

1* What was the population of interest? 

2* What was the feature of interest? ' 
3,, What was the sample you have chosen? - . ' 

When to Use a 



When' information on a certain population is needed, the surest way is 
to check the entire population. But such - an approach is usttally impractical 
and sometimes even impossible; 

When the Releggint Population Is Very^cfctge * For example, scientists want 
to)learn about the cdmposition of thejioon's soil* It is impossible to check' 
the entire soil of the moon* Instead, samples of it are investigated- - 

When the Costs (Mbney, time, or Personnel) involved in CbeckW the Whole 
Population Are Too Hi#u Counting all the vehicles using a given roa4^du_ring~ 
the whole year would be *a costly task in terms of researelr crew and time 
involved, Testing the efficiency of a new medicine oa the entire population 
of people who suffer from a specific disease would be enormously expensive; ; 
quantities of professional workess^ sophisticated, equipment, facilities, and 
time would be required* Moreover, such a large-scale testing is almost impos- 
sible because some people do not know they suffer from the specific disease, 
others are hard to locate, and sti£l others would not agree^for various red- 
sons, to 'serve as "guinea pigs* tf , / / , * 

^In such cases, it is more practical Wd convenient to use a sampltf* \ 

When a Portion of the Relevant Population JCs Inaccessible * A hospital 
Wishes to assess the differences in body weight between male and female v babies* 
The*entire relevant population consists of all- babies bom recently, those 
who are bom right now/ and those w hb will be born in the futtfreA How can 
babies not yet bom be checked? * 4 

f The Testing Procedure Either Destroys or Alters the* Tested Items * Testb* 
ing tjie entire? population, therefore, will result in totqi destruction* 
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A manufacturer of jaatthes ha,s Recently received complaints from customers 
it their matches tend to break'when struck< The company wants to check the ^ 
teogth of the tfatchgM&hat are^now being packed for shipment,, Testing their 
rength by striking ai^of ^them would destroy an entire shipmeht* Therefore, 
5 ting a sample is & better idea* , 

* 

, "A testing lab is asked to check the durability of some glass cookware 
it is supposed to be heat resistant * Xhe lap intends. to check, the maximum . 
nperature that this cookware can stand* # The 1 testing procedure ^riLll be to 
it the product and keep V continuous record of its condit£^^t : ^Lf f erent 
rels of heat until^it fails* Obviously, stich a destructive /test^pg proce- 
:e cannot be performed on all thtf* factory's line of cookware* Instead, only 
sample can be subjected to such testing, < * . * 

t In sum^ we have seen that in many cases £ sample is the best way to get 
estimate of a certain*phenomenon in a total population* * 

it Is a Gogd Sample ? t * A . 

_ ' & * ^ v + * 

• Using a sample instead of checking the entire population is, as Y$S/e 
n, common and sometimes even indispensable* .We have also^seen thdt various 
iples can be selected from the same population* Thus We must now jjtsjWtfte 
lowing quest ions : 

1* What is a good.satople? v ^^1* 

2* ^How can such a sample be chosen from the popufation? 

3* Given certain results based on" a sample, to what e'xtent ca^we rely 
£hat sample? • f « " t - , V 

Bet us peal , with the r first question* The 'result obtained by checking a 
pie, (for instance, the percentage ,of trucks out* of all vehicles driven on a 
d during a week) serves atf an estimate of the simile result in the popula— , 
n as' a whole (the same percentage during the whole year ) * * ■ 

\ . * * * * \ * 41 

the estiina£e qitfefl^ed from a % samplers better t£ the extent £hat it is 
ie^o true figyre, (which can be obtained, in principle; if the entire 
illation ±i tested)* Therefore, a gbod sample is one that pr6vides a good 
imate * • Such a sample is called a < representative sample , namely, the esti- 
e obtained frdm it represents, or reflects, the relevant feature in the 
Le population* * * 

; * ■ V * r , § , 

*-Let*us assume that 52% of the whole population likaithe TV program 

V*S*H in 'World War Sit" (of Jourse, the percentage of the entire population 

ictualljj ut&nown. and that is why we need a sample)* To -the extent that 

percentage of interested respondents J!n our sample „is close to 52%, the 
>le is more' representative' and tfie e^fimate derived f rom it is better (in 

sense that it is c^Pser to; the true value), * 
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A good sample is representative; i^ reflects the entire 
population- regarding tj*# feature 6f interest* t 



We choose a sample in order to avoid investigating the entire population • 
Therefore, we cannot judge whether or not a sample is representative of ttie 
<fepture pf interest" by comparing its results to those of the population* We 
infer from the sample to the' p opulation, rather'than compare the former with" 
£h& latter* ► ' 

- , , ■ * - ^ , 

Sq how can we ensure in advance, or at,lgast increase tfie chancers, that, 
the sample we choose will be representative regarding 'the feature <of interest? 
We are dealing now vith thfe question, how does one select a good sample? 

flff ollowing*are two situations in which ±^ is relatively easy to choose 4 
good sample; * *" ,;. 

*\-- ^ " " ' * 

1, When a physician needs to know the number t of red blood, cells in a 
patient's blo,od,,*usually a blood test will be conducted on a" single drop of 
"blood* T^atidpop'will serve as £ samp la representing, the composition of the 
patient's entfre T)lood> % ' 

2* When a public health ag^cy wishes lo know" the*perfcentage of chlorine 
in the drinking water dt a certain neighborhood, one drop of water will 
usually suffice for checking and estimating thisfcmattet for the* entire "popu- 
latipn of drinking water" in the area* 

. In these two examples, tKe populations involved (blood in the human -body, 
drinkidg water in the neighborhoptf) are homogeneous concerning the invest!^ 
gated' feature , One dro£ of biood is essentially - identical in its composit 

ito another drop Irom ^he same body; this homogeneity applies also to water T . 

♦Therefore, we can infer~the*investigate,d feature -(blood composition, for in- 
stance) from 'any small sample* Afiy sample that is chosen in this case will 
be;"good," for it is # almos^certainly identical in this trait to the entire 
population^ Here, then, the result of any sample tested will be identical 
to^ttfe true value—blood or water composition* However, such cases, in wfyich 
tlie popul^tibn is homogeneous in* regard to the investigated feature , are rare 
indeed/ In most instances the population is not homogeneous with respect to 
£he feSturp of |>ntare£t* Quite often, this lack of .uniformity is precisely 

'the core of^our interest* * ' /* 

4 ' ' ^ J 

r , People Is opinion about a TV program Is not uniform* We want to learn 
howmany people like the program, how, many are indifferent, and how many 
dislike it* - " . ' . , * * 

* /Hot all thB yefcicles driven on a road are trucks* * The percentage of t 
*tnf?J<is, is What (We^nee^S to know to'design the repaving*\/ 

t * * * * * *~ ' f , . ■ . - 

In ^preparation for a possible draft, the army wants £o know tlie height pf 

18 ^ajnd 19>\e6r cjl$B fox t\t& purpose of ordering adequate clothing* Obviously 

th^re* are 'Inferences *in height; the army wished to obtain estimates of the 

Ijercerttages of re£riiits ip eacH height category (for instance, very tall — 

above e^ 11 ,, taJjMjptween . 5 f U M and V2 n f and average— between 5'7" and'j'lO", 

etc*), * - . * ' L ■ * • - ; - : ; 4 : . 



/*'.. . 

When the- population is not homogeneous, not every sample is '& goot 
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^ A group of mep eating lunch v in an expensive oresftaurant discussed Tthe 
average annual income of American men* After- /a long debate tfce o^g^je deci-d£d * 
to use themselves as a sample* Each one wrote*down his annual wages afld they^- 
calculated the average* This figure served them *as an .estimate of the average 
annual income-ji£all Americkri'men* m * <' / ' 

. • • .j> • - ■ ■ / : f 

Is this* a good estimate? I» the'*sample selected by th& diners representa- 
tive of all ihen in the,cpuntrytf "Probably not. The entire population includes 
people ^with high, rfedium, and low galaxies, H^d the sample included map<b€^ 
longing to all three classes of salary^J^evel, there would be a better Jfiance ' 
that ^the estimate derived f ^pm it (the average income) would be clo^ to the 
•average' in the population*, .gp^eVer- since the sample consisted of men having 
lunch in an expensive restaurant/ it is reasonable'to assume -that they, were * 
all well-to-do* Therefore, this gample cannot be rega^ddd tfs representative 
of the whole population, 'and an estimate obtained from it i£*no£*a gopti^one *' 
(because it will not be close to the true valtte) „ This is a' biased sample* 



/ / 
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A biased sample is a sample that <Joes not represent a popu- 
lation with, regard to title feature of interest* 



When e population is not hoajcjgeneous, not eve^y sfajople will represent it, 
This 4 i£ the case in most injj^ance^that' we. are interested in investigating* 
It is important when dealing with such populations that tjife samples drawn will v 
be* representative* Ho^ can we select represent art ive samples? How can we 
avoid biased ones? > * 



Exercises 



Choose^ a sample to b^^usedin estimating the percentage of people having 
the * following characteristics'^ the~entire U*ff: population* \fl\at t is a' bad 
sampling method for^each characteristic (i*e* t a sampling method that will 
result in a very biSe<f sample) ? 4 



1 

The characteristic 

v • r Has |i telephone 

• Likes classical music 

• Is married * , 

• r *Is a Republican ' ' 

• Speaks English fluently . 

• Lik^s football 

•* Weighs' more than 185 lbs*^ 

• T,eacb6s at a university 

• pas fathered one fcltild 

• Harf a high "school' dfplonb 



A bad sampling method 
£ A telephone survey 



\ 



ERIC 



72 



85 



How to Choos^ 1 
^ * , The. Popart* 



-J 
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_ ^ jrtjperifc /of , Eduction wishes to know ^afc,^opo$tio£ of high schoai ^ / ' ^ 
senior^ pl^ris. to ^o, to # £olieg*»/^4 hires a i&stetfh jErcient£st to. teiftkfrgt sjipro^" 
priate^res^wV'rfn the topic^ .j™* 8 scientist [^^^ ^nj^n^%t£k f n^£-thr£e:"S v * 
private- hJ^h^ebopls * .It is mos,t cqavenient-ioi h^r»?in tit^££"]ti»^ 
and acfiessifeUtty^ to choose, a sample fi^mjme, tfe^eg neatly high ic^ol^/ * [ " ■ > v - 

/ W£2jL $tich a proposed staple be representative? Will this samgle > dotij&l^t- ^ , 
itig of^the senior^ftom.,th»e, Manhattan private! sc^oold* rapraaenf "all 
high sdiool sgniprs on the characteristic, college glans? ^Prdb^fiy wtiy m T$jtei\ 
sample is.probably biased.; ' ^ •* ' V- v ff - > T *^ * 
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How can tire Judge vhethel? the result bss^t,on such a sample viXi-1Jfe* 
unbiased? 

1. First, ask *o.urselyes whether the potential sample differs signify 
. icantly from the entire population, # The ans^r Is ^Efirmativer Xhe v frt5pula- 
■ £ion i,s comprised of high school ^en^ors residing in cltiea, towns* and rural 
* areas, whereas the proposed* samplers madeVp 1 solely of stu^nts in' a matrc^""" 
poll tan area* Thus, the sample . dras not represent the relevant population in" 
connection, with the feature rural/urbdn. Furthermore, the population contains / 
t bothjpubiic school and pHvate school -students^ vhersjp the sample contains* f 
only the latter;\ • ' ' / ■ ( ^l" 7 - ^- 

'■ ' '. \ - - - L - * ' • ' V \ ' \ 

- „2v the^u ask ^whether tj>e features rural/urtan and public/priVat^ have - t 
sotpe^ relation to ;the ; feature colleg^-plap^, Zn ojsder wot'ds, the question is , ,; - 
whethex cij:y residents -differ fropi tovm^ifid *rural res'ident;^ and whether public 
school ~3tudgn$s -diffe^. frob pifivatfe s^ool stude^s.in, theix intd^tionsrror % 
' c0llfig^' : bei^ve^siich^^ - ' - ' ^* 

"m, T ?1f-.tf0 as.siMfi, tHen^. *t$&£ there Is a highASJianCe that the proposed sample ^ 
is^-.not ,'r^reseTitative of 'the entire pdpulatljDj^TiQt: ^daly in the features * / "f 
V: r^raj/urbe^^ at the moinept) but 

-'. alsc^in the. research topic colieg^ ptaits*>v^ <# * ; ^ . ^ ■ 

"* 4 ' Bfe disqualified the ^feattaj^ private ^^ofer^aa?pl^S^ecausfe i$rdoes,Rot \ • 
tepreseint" the population ;i|i ty^JfeatuTteB' that we.believ^are iSbj^ted Jj^tM * ^ 
feature>of interest,.- We* can use these, s^me cohside'rations to* try^e^eiect a' * ^ 
representative sample, sa that" *e will.be ablife £.o_.putTnore. trust *fn ah ,esfei^ ^ '- 
inate obtained fxbm it , ^ " '* v ^ ^ . 

v . ... ;,: ^ . ' \ ... . ' 

*' Before (tiot^fter) polling tfee ^tnple, we\can think of other character-., 

istics that we believe are related to the fedtur^'o^ teteyest^ an^i plan r 




estimate will be close tsp the true value* 



What are th^ 



^^kct^tsii^sj-i^^^ to colWgfe plsns? 




•; 



"-jft^'have^already meivtiton^cl private Vgj3**s f *pt*bl t ic, schoqls *\ We should take 
thia fchliraCtertetic into\accouht In" oureamplV^ l£-we i&ow t|pat 3% of all 
- tr^, seniors attead prriv&te scliboi^, then ip a sample of^. pay 1,000 student^; 



^rve^aKs^uld 1 include 3o (32) f^omjrivate' schools ^d the rest fromlpublic, sclbools. 
^ >Idkewise, <we should include in our sample, a proportion of citjs^o^n, and 




'i^{;^ B ^y*taiBiin!i3/- *fe-l±st here justr a few 



* Parents/* educatioii (did one or both of the parents attend college?)* 
y .Patents 1 ; Income, and " , - ( \ 
* • Number* of boofeg/in fhestudent's home* * / \J 

: . \ "/ ' / * > . ■ " * 

V- pipre are purely 4 ot^er characteristics t^hked^to collegfe plans*' such as 
•* ,sex of the student, number of, childred in the family, and' certain personality 
traits of the student* , t 



How, if We want the investigated Sample to be 'similar ,to the population 
£n:all fhese "characteristics linked to 'the feature of Untey^st, we need tc 
:he following:' - ) * 



in -all fhese "characteristics linked tp 'the feature of 'interest, we need to do 
,£he following: 

7 | " v # f * \ 

1. Hake an inclusive list of 'the characteristics we believe are related 
to the feature of interest*- * 



2. Check fj^e proportion of eattt one of these characteristics *in the 



p^pulat ion* 

;3*V Make sure 
* c harac ttfWis t ic s 




ft 



e will be cTSmparabJ^ representation of these 



e* 



^ese-Hj W*\ as you may have suspected; are impossible* first,, 

enatjre *that we will think of all possible important characteristics 

•'♦■ pelated to th0. feature of interest* Some of them we migh£ simply overlook 

Vnstance, the . parents 1 education) f while" there, are §ufely other charac-, 
zerjLsticsitixat are- related to the feature of interest -unbeknownst to us* * j 

* . ■ (I 1 f . , . * 

S^qond, ev£mif we were tp incluji*. every possibly influencing character* 
we t£ou!c( nt>t know^he proportion of ^eph one'^n the population* • (For 
i, how Uiany ^studknfcs* Twimes ^aye more tt^an 200 books? 'What is the per~ 
^ c&ntag& of Students having' a high' lev^l bf 'selfn:qnfidekc'e?) *■ 



. - if 



In 1 order to know pll «ese\facts]^e would havpi to'co^duat septate te- 
search projects cc^cetning e^chr ?fe^ait^cistic t end- for thajtjwe Wbuld r need 



appropriate samples* THus f^e n^ve^^ndiqg reqJi^ 

r^for^ thist itethdd is imprac^tcal;. indeed, it Is ie(.dom used?^ 



or good samples. 

,1:..-. , 
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Rand om. 3ampU.nfc ; ' 1 

~* > ^ V L * : ■ ' - yf® - 

4 Th^re is anptfi^t easier method y for dealing with sample problems* It is 
.called th^tostKod of random sampling . We will ffcpst demonstrate this*method 
^us^ng the 4 same r^gearch sample, ' . p f 

let us assii^ ( th'a^ 't;l(e tot^^mber of high school seniors is 3 million* 
Igt us assume f^t^r that the .research scientist ha$ the college ,plaqs of. 
tSese' students, on pfci&$>lipfe aax& pet person* Thestf3 million cards can . be 
sjiuffled^by a gigantic ^automatM shuffjing machine, which c^a spit ojit a num- 

ber*o£ cards after shuffling them* - 

** ■■ +. h * . -* * ■ ■ < i * ■ 

? " - -' ; . ' ^ \ " * * * 

In order to selec't a^^ample of l^OOu students, 

1 the machine ' 

£hub )ias 

method? 

K ' i; Each "item 11 (card, person) Im^th^ same cljance of being included 
in the^sample as an£ other item* >v 

2* The change of a certain "Ite^nf s inclusion, in the sample is independent 
of any other item's chancer + Tfi&t %s\ whether or not a Certain item is include 
has no influence whatsoever oa whether or + not any dther item will 6e included 
too* This stems ^rom_,the £act that, due to the\shuff ling, all possible items 
of the popula j tion_axre available- for selgctioQ^-^ "7"j « L * 

This, is random sampling, which is characterj^a by the fact that the sole 
determinant of inclusion in the gamglg ig changed Sere, then, v«* cannot know 
in advance what will be the composition* .of the sample (for Example, how many 
private school^ffjrtidents wilt be included)* , / 

♦tfate that such landomness 1 d6es- not^kist when vm ere using the former 
sampling method* hfe we determined that* for instance, 30 jfltivafceHBchool 
students would J?e inAuded in the sample* IA, other words, we determined in 
advance the sample cjjfttitutiofi , r£th£i; than having it being -determined by 
pure chance t Moreover.* if the investigator ,ln this example woul4 indeed base „ 

the sample solely on the, students ^t three Manhattan priv^fe schools,, this 

approach will 1 be eyen less random, ,for not oti\y yould public school, students 
have no, cbapce of* inclusion in (h$ sample, r but also other n^&fete school pt,u- 
dents woul^l be excluded* In other words, the invfestigatoj?^ in^fact, deter- 
mined in advance ekac|ly Who woi^ld be included* ^ ' ■. 

Another example concerns a scbteL teacher who^wants to ordetf ascertain 
film for the school's ^xtraf-curricular^entertaiftment program*, Hg is. inter- 
ested in knowing^ the percentage of his school's 'students' who «h6j£e ^tfTready . 
seen it, does not Want to bothe'r asking eVery single student^, whether he 
or she Has seen the film, *for th^t would b.e time consuming and would inters $ 
fire with an already busy, schedule,' Thfe school teacher decides, therefore* 
to rely on a sample of students*, Naturally, he wishes the sample to repre* 
sent as* much as possible the entire student population in regard tp the 
true peicentafce.of tho^e who have seeji the 1 • " • 



If be 'decides to utilize the firsj sampling method, he should first 
think of all the characteristics liitked to- has seen/has not seen the film 
~'\ and then try to. represent them in the sample* Some examples of such charac- 
teristics are class level (seniors have more homework to do than juniors, 
j so they have less time available fpr going. to the monies) t - residential area 

distance from most movie theaters) t possibly gender £if it is a war filmjfj 
Q, mqre J m^l£§ may- have seen it than females)^ and so bn* . * 



4 We have, already discussed the /difficulties involved in this, nfethod, If t 
iiistread,- the school teacher decides rather tVaise the random gaggling method » 
he can use the students* fi^es, decide what will be the sample ^9lze, say 100,4 
^and then select. 100 names from the files randomly * 'For instance/"*** can throw 
all the cards in fr^nt of *a fan and pick up, for his sample, the 100 cards 
that^land closest to the/water cooler (this ; sampling procedure, though ridic- 
uj-ous* is intended to demonstrate frgaiti the 'term random). / - * 



Using the random sampling method we select a sample such that; 

* * 

1* Each item in the, population ha^an equal chance of 
s inclusion in the sample. 

2* A particular item'.s chance of inclusion %vl the sample 
is independent of any other item's chance * * t 



A sample selected by^this methdd is called ^ random sample , 



tfjjen ustag the first, representative-characteristic method, we wejfe care^ 
' ful to ensur^ in the sahple adequate representation df characteristics we b« 
Xieved ha4>spme connection to the investigated one* Thus, we were hoping ^the 
investigated characteristic would also be represented in the sample/; ttyer^by 
■ ■ ensuring- *a good estimate* 

* \ ■ . - 

.Noi^ after the random sampling method .has* been introduced, the same 
.basic jyiestion applies: Sow can we make sure there is adequate* representation 
using .this liethod? For. without representation of various characteristics, the^ 
pftances ara IpWthat'the^ sample wilZ be representative of the investigated 
characteristicrand that the^estlmate will be close to the true value* Using 
the first methpd» weWsured beyond doubt adequate representativeness of such 
c^ardctteristifcs, claiming that this r increases, the chances of having adequate 
representation of (he investigated characteristic too* Using the random metB6d , 
|Ve cgnrart\gsujte anything definitely * However,, as yQtf will soon See, tHere is. 
* fa, high chgn 
cha^tftt^r: 
saved 



^tfeat the sample represents the population with respect to all 
including the investigated prie, and chr gain %a that 
qI Vtie dosts involved! 4Ln.*ijttpleiDentin^ the first atethod* 



4 ' ' ■ \ ■ > + f , ■ v 

. . r V& -fcrtil discjf&ffWarioiis conslderations^fayplved ILn-dfeciding sactple size 4 

liter* s -:v ■ - V * * r • - ' . * 
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) 



, . There are 
similar 



1,000 small balls in a jar* 



They are^numbeijed, and all are 
^ smaiar in size and shape* Ten of these balls (1%) are red and the rest, 
^990 (99%) are white* ^ We can draw a random saa^le of 100 balls by stirring 
the balls and then drawing out 100 vith our~eye^ closed* What is the chance 
that sufch a sample will be made up mostly of^red b£Lis (say, 70 red and 30 
white)? This chance can be computed, but even without computation we would 
agree that such *a*chance Is quite small, for most of the balls in the jar are 
white* Therefore,!^ wou}.d egp&ct that there- is a high chance of obtaining 
* in which most of the bal3bs 



a s 



balls are white. 



It is highly improbable that such a sample would be made up of exactly 
1Z of red balls (that, is, 1 such ball) and 99% white balls, (99)* Yet most of 
the balls in the sample will be trtiite, and very few (err none) will be red* * 

Similarly, if 3% of all high school seniors attend private? schools, by 
sampling 1,000 students randomly the chances o^f getting ycactly 30 private 
soBool students is very sisal!, but we have a- good.xhance of getting appropri- 
ately 30 private school students and about 970 public school students* The 

same rule applies to all* other characteristics discussed here* • # * 

* . _ * 



Utilizing^ the random sampling method, .we expect to obtaip an 
approximate representation of all ^oss^ble characteristics, 
without havijp to "think in advance aboat all the characteris- 
tics or to know tfieir p"fbporTiOT^ln"£he"popula^T§h* * o 



s<4 



— T~- • ■ ' — _ ■ 

When researchers use the firfft sdtopling method, they*usually ^combine* it ^ 
with the second one* If, for instance) in our example of high school e 
the researchers want to ensure representation of public/private school* 
will decide that there will be, say, 30 private school students l and 970 
lie school students (according to the appropriate percentages in the popi 
The 30 private sahool Students will be selected rand^jml* from all private 
school students, and similarly, the other 970 will beT^fel^cted rSttflomly fponn 
among* tbe rest* Sucfi a ^ampie is called ^ stratified sample * * t / 



Exercises : * 4 . * . ■ 

1* *In the following table, each cell represents a sample of a particular 
characteristic, tfftmpled in ascertain way* Writean R in each cell for which 
you believe the sampling is representative; write a B if you think the sampling 
is biased* 4 The population o£ concert is the entire population of the country. 
Expla^yfiur answers for each cgse* * \ * 



4 



.0- 




do 



1-^* "I 



1. Sending letters to* every 
10th addreSsytrfting the 
files o| the AFL-SJO. 



No. Yrs. Blood No* 
School Type Height T?s Gender 



2. Interviewing ^adults whose 
* Social Security number's 

.last three digits are 357. 

3. Interviewing every person 
* who passes by ascertain 

cafe one morning. 

4. Interviewing all Manhattan 
high school seniors. 

• 

5. Interviewing the parents 
s who attend PTA meetings 

of. 10 elementary schools 
in Chicago. 



"5 



/ 2._ For every B you 'marked in the former exercise, write down the largest 
populating for w hich it wotfld be proper , to wake inferences^ rom the sample to 
the population. , t , J 

Sampling Error * a 

It is implausible that using the random sampling method we will select a 
senile which exactly represents the population iq, the in^jpstigated character- 
istic (namely, that the estimate obtained from itwillTJe i'deriS^eal to the 
true value, which would fTave been computed had we checked the entire popula- ' 
tion) . There wiUL nearly always be some 'error . 



A nurse in a college Infirmary wishes to know the average weight of enter 
log 'freshmen to compare with sjm^lar data she collected 10 yeatfs W>*». 

1, She can weigh each entering freshman and .divide the totai weight by 
the number of students weighed; the result will hja^lhe desiysble average. 

% . -Total w/i#i£ "of ^11 : 

* • % The average weight freshmen this year 

T of .freshmen ; ^ Nuiafeer of student^ yetted 

Let %is assume she 4iPthat l and the result she got was 135 lbs* This la 
the true value. " , • * 

€ ' , ' * 

j . 2. She cair sayef time and effort by jwelghliig only a sample' of students. 
Lefftis .suppose she decided to choose 30 students randomly # „She weighed .them 
■ and calculated ttie average- In a similar way; 



1 t 
The average Weight s Total weight of the 30 students 

of 30 students 30 
Let^us say the average she calculated was 138 lbs* 

If the nurse selected another random sample of 30 students, sh 6 would 
get another number, perhaps 127, 145, or maybe 136 lbs* Any number based 
upon results of*a sample will be merely an estimate, and there will usually 
be errors When she computed the average based on her first sample, she got 
138 lb^T, a difference of 3 lb#* between thi5 estimate and the true- value* 
If her estimate on another sample was, say, 142 lbs*, the error would have, 
been 7 lbs* . * 



The difference between the estimate and the true value 
calle^ sampling error* , ^ 



X 



* Such an error will almost always occur* It stems from the heterogeneity 
c^f the population and the fact of sampling, that is, in sampling we check only 
a portion rather that* the whole population** K 

■ * 
We cannot guarantee that such an error will not occur, for it is always - 
expected when inferring from a sample to the entire population* However, we 
will always attempt to minimize the error* 1 - ' 

The sampling error will be smaller to the extent that the samplS is more 
representative of the investigated characteristic* How can we ensure a repre- 
sentative sample when sampling randomly ?TjPue to the pature of random sampling 
we , cannot*, of course, ensure ^aj^thing definitely* However, f K 



1* Random sampling increases the chat 
sentative (in contrast to n on random sampllt 



:e that the sample will be repre- 

». ■ ■ * ■ 



2* The chance that a random sample will be representative increases to 
^fhe extent- that the sample is larger* , 

x What is the connection between sample size and representative sample? 

'Imagin^'that the nurse, who is still interested in the average weight of 
incoming freshmen, chooses two students randomly, weighs them, and computes 
thei* average weight* This figure is an estimate of the average weight tff , 
all ^incoming fVeshmen** But it could happen that the 'nurse chose either two * 
4 I fat shodents, whose Average weight is, say, 180 lbs*, or two *very slim stu- 
dents/whose average vefijta 1b 80 lbs* These heights, one very higtt and one 
w very I^t^ap^T^rt^ousty.^ad estimates of the true average Weight in the 
^pulationHl35 lMy) \inl$/the sampling errors are so large (45 and 55 lbs*). 



It is much les^liktly that such extreme averages will occur when ran- 
domly "bampiing 30 stu3ents, rather than 2, Among these 30, there will prob- 
ably be some who are heavier thatf the average Csay, 160 lbs* or mxyce) and 
atill others who are lighter than the average (say, 105 lbs* or less}* It 
is unlikely that the randomly choden 30 students are'all extremely fat or all 
slim* Thejje&vier than average afd the Slimmer than average will tend to 



79, 



92 



er|c 



balance one another, and the total average will be around 135 lbat* It is 
v$ry likely, therefore, that the sampling error based upon the weights of 
% 30 randomly Sampled students Will be much smaller than that based on only 
2 students* . * ' * 

J 

< .This example demonstrates the general rule: * 



A large sample, selected randomly, increases thfe chances 
that the sample is representative", the estimate is good, dad the 
sampling error is small* 

As the sample gets larger, the chance of a large error 
diminishes* ^ * 

When the sample is actually the entire population, the esti- 
mate ii equal to the true valpe, &nd the error will be zero. 

: : <L- 



Exercises . * 

Following is a list of nine populations. For each one: 
1 "Formulate a question that may interest someone (including you). 

4 

2* Fjlnt out how you might select, a good sample from the population to 
obtain an estimate about the question^of interest, 

• The population of chairs manufactured by a specified compan^ 

' ' ' • The population of cabbage butterflies, * ^ 

• The population of scientists in the United States, 

• The population of words Beginning with the letter H, 

• The population of books printed in the United States, 

• The population of babies Born in California, ' 

• The population of urban areas in the woi^ld, 

• The population of treaties that were aigned in the past among 
^ varioua nations, and 

The population of 80 year olda in the United States** 



CHAPTER 7 v 1 

- ^ SAMPUNG: PART II 

What Is Sampling From Memory? ^ , 

Think a bit about the following questions and suggest Jan answer for each: 

I* * Which are mq^re mumerous,in the English language? 

. a ^ Words, beginning wit?h the letter M, or 

\ - r\ ' * , * ' ■ - 

b. Wotds beginning with xhfe letter Q? 

2, Which are more numerous in the English language? , # 

^ ■ n '.A ■ 

, a, Wocds the third letter of which is R, or 

b* Words beginning with £he letter R? 

t Probably, most pf you answered £ for the first question, and b. for the 
second* That is, most of you believe thare are more words beginning with M 
than words beginning with Q and more words beginning with R tharu words the 
third letter of which is R* > * 

Before checking the dictionary to see if these answers are correct, let 1 
us try to reconstruct the thinking processes involved in your attempts to " 
answer these questions* « 

l You probably trie^, for the first question^ to recall words beginning 
with M and words beginning with Q. In this short attempt you recalled more 
of the former than the latter, an8 this led you to conclude that this situa- 
tion is general in the language: " * f » 

* a' . ' \ 

Similarly f you tried to/ recall words beginning wit;h R and those o,f which 
the third letter "is R* Because you were able to recall more word^ beginning 
with R, you decided that this situation is general in English* 



j 

* ;-poes this process remind you of something? We hope it^-a^jjjlnps you of the 
sampling issues we discussed in the previous chapter* Here agatt, we are not' 
dealing with the entire population — the complete English vocabulary — but 
rather with a portion*of it: the words you could recall* 

r . * 

< 1* We asked ab^ut the population of words beginning with M and with Q* 

2. The jdesi^ed characteristic was words beginning with M and wojrds be- 
ginning with Q* 1 f 

3* The answer was based* on k sample: Words beginning with M and those 
beginning .with Q that you refcallfed in a short time* * - — ^ 

jt* Because most words you recalled were those beginning with M s you in- 
ferred, ^hat there are mo^e words beginning with this letter than those begin- 
ning with Q in the entire 4 language (the population)* 



This conclLsio^^flSS^base^ on "the sample you retrieved from aembry* The 
words recalled \n that lt sbort -period served as a sample^representing the popula- 
tion as a. whole* The situation is similar £ov the secon^ question. Try to 
specify the population, the characteristic, and the sample for It, 

t t V 

* Note that these two samples were not selected from a newspaper, a book, or 
a dictionary but rather were created Internally by -thinking* Which Items were 
Included In these samples? Each wotd having the desired characteristic that 
you Recalled during short time* * 



during 



Sampling .from 'memory yields a sample of Items that one recalls 
ng a specified period of time, * i 



This, Is certainly not the first time you haVe sampled from memory* This 
form fcf sampling is common when one la attempting to estimate quantities tn 
uncertain situations* For example, 

1* Which are more frequent on U,S. roads, GM or Ford cys? If - asked 
this* question,- you will probably try to ree^dl cars belonging to tXiends, 
acquaintances,' neighbors, etc., and you will Infer from this sample to the 
general situation* * ^ — ^ 

\_ ' ^ 

" 2, Which are more frequefft in the United States, families with two 
children 'or those with one? Again, you will search y your memory, and If among 
the people you know there are more families with two children you will con- 
clude that foils is, the situation in the entire population* 

Is this sampling fre$i memory procedure "good" or "correct?" Does it 
qualify in terms of the principles of good sampling discussed before? 

Does Sampling From Memory Produce Good Samples ? 

In the appendix to this chapter is a name list of various people* Read 
the whole list once (now, before reading beyond this paragraph) and return to 
this page* Please have a pencil and paper; really* 

This list serves as ^'population* Afe are interested in the following 
question: Are there more men or women in the list (in the population)? 
(Plgftse do not reread the list yet,) 

r * 

Now, write down the sampling you did just now In your mind* Write dowta ^ 
all the names of the men and wom^A that you can recall from that list* Do it 
quickly; 'do not spend more than half.a minute on this task* ■ ^ 
t r 

Now look at the list that you wrote* Are" there more men than women in 
It?, *In former expetiments dealing with this task, It was found that most of, 
the sublets <high school and college students as well as older people) re- 
called tand"4*rote down more women's names than men T s names* Henc^, these sub- 
jects concluded that there aire more wotaen* s iaames to the original list* flow 
about you? t Did you draw the same conclusion on the basis of the list of 
names you recalled? < ; \ m> y 
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If you now check the original list ^ou will see that chose of yoU who 
decided that it contains more women's name^were wrong* THere^aie more men's' 
names on it* ^ \ " \ 

* * ■ * 

We have said before that a good sampling procedure may laad to a bad 
result (a sample not representative of the entire popujL'atJ^on) Vnd* thus a 
biased estimate* Nevertheless, it is surprising that most peopfre tend to_re-' 
call, in this case, an "unrepresentative" sample (most of us recall mote wo/- 
men's names than men's names, contrary to Vhe men/wo/nen^ ratio in the original 
list)* Why did most of us produce a biased sample? In order to understand 
the reasons for that, let us consider sampling from memory in the light of the 
sampling principles discussed in the previous chapter* 

f . ) ' 

We have said that in order to increase the chances of the selected sample 
being representative of the population, we ought to ensure the following, two 
p rinc iples ; * J * 

1. The items will be sampled randomly. + * 

2. ' There will be many items selected (the sample w^li not' be too small)'. 

In chapter 6, we presented some' methods one can use to sample randomly, 
like drawing cards with eyes closed, using a shuffling machine, 4 and sb on* 
We will cheek now whether sampldng from memory is*£ ^ "random 1 ! sampling prpc^e- 
dure* Does it satisfy the two principles mentioned before? In other words, 

1. Does every one of the items have the same chance of being recalled? 

2* Is the chance of recalling any one item independent of- thl chance 
of every other item? * + y ^ •/ 

Dc^s Every Item Have the Same Chance of Being Recalled ? \ 

* 

m * * 

The Availability Principle * In the very first example in this chapter, 
we asked which are more numerous in ^English; words beginning with the Jetter^ 
M or words beginning* yith Q* We based our answer on the sample of words we 
could recall . ^ ^ 

When trying to answer that question, did each word beginning with M and * 
each one beginning with Q have the same chance of being recalled? Did every 
word have the same chance, or were there some^words that had no chance at V 
all? There are, for sure, some words that we do* not know and, that„we have 
never used in our vocabulary, fo& they are very .rare in daily language* use 
(for example, meristic, miniver, quadrat, an3 quartan). The chances of such 
'totally unfamiliar words being recalled are practically zero, no matter how 
much effort we put into qur thinking; * , 

Hence*; this is a situation where we actually did^not sample from the 
total population, but rather from a portion of it ,* If there aire words which 
have n^ chance of recall, the principle that every item has the satie bhance , 
oMFeing recalled is violated* ■ s / ' , V 

.' . 9€ 



We cdh probably think of situations where ire sample in -our memory from 
the entirg - population. In such cases, does every item haye/the same chance, 
of being sampled? Let us Check that experimentally* 

Following ig a lis£"7>f wor£s . Pleas£ read it once 'and then cover it up, 

-cold, bolide, enol/nice, warm, ^gavial,' 
akee, friend, fqin, girl, picture, scop 

" * ' *' , - * * 

Now wtite downfall the Hprds you remember. Which of the words do you 

remember easily? naturally, the one (that are familiar *(cold, nice, warm, 

friend, girl, picture)* These are more easily recalled than the unfamiliar 

(bolide, enol, gavial, akee,,foin, Scop)* Thus, familiar words are more 

available in memory* Generally, a high familiar things or event that we have 

beea repeatedly exposed to is more available in our memoi?v; its chances of* 

being recall'ed are greater* * , " j ^ 

^ 1 3 : 



* Sopie'i^&ns in our memory are more available than others; 
that is, some items have a greater chance of being recalled 
than other it^ems have* 



therefore, even if we sample from the entire population , not every item 
has the- same chance of ^eing remembered* For that reason^ sampling from 
memory is' not random * . . ^ * 

Let us review again the list in the appendix* We now ean see'why we were 
able' to remember more women's names than men's names, that is, why .our sample* 
was biased. For the purpose of demonstration, the list was compiled t&*in- 
clude names of very famous women, whereas the men listed are less well known* 
When asked to recall these, we were able to remember more women than men, be- 
cause being better known increased woman's recall chances in comparison with 
the men's chances* 1 f 



Familiar, well-knowii, and prominent items are more availabler 
in memory than -items not having these qualities* 



Another feature or, memory is* demonstrated here* If we return to the 
original .list and the rep ailed one, we will^realize that it is easier to re- 
call both the beginning ^nd the end of it thaU the middle, that is, thb items 
at l?oth extremes are, more easily recalled than the middle items* Several ex- 
planations have beep offered for this phenomenon* Some researchers think that 
fewer factor^ interfering with recall exist for both the first item on the 
list (before which there 4 are no items) and the last £ne (after which there 
are none)* Ip contract, the middle il^edns interfere w^th each other* Others 
'beliterve we are .more attentive to the first and the last word of a list than 
to words in the middle of a list* Still others say that the last words In a 
list &re .closer in, time to the start of recalling the l^st so they "do not 
have time" to be forgotten. 



We cafr probably think of situations where -1Je sample in -our memory from 
the entire * population p In such cases, , does every item have-* the same chance, 

of being sampled? Let us Check that experimentally* 

* * , * * >* - - ♦ 

Following is a lis£T>f words- Please read it once "and then 'cover it up* 

-cold, bolide, enol,*nice, warm, ^gavial,* 
akee, friend, fqin, girl, picture, scop 

Now wtite down^ all the wjords you remember. Which of the words do you 

remember easily? naturally, the one (that are familiar > (cold, nice, warm, 

friend, girl, picture)* These are more easily recalled than the unfamiliar 

(bolide, enal, gavial, akee,,foin, scop) . Thus, familiar words are more 

available iji memory* Generally, a high familiar thing* or event that we have 

b&4n repeatedly exposed to is more available in our memoi?v; its chances of* 

being recalled are greater* ' \ p * J ^ 

■ ( J 4 ^ 



' Sope i^etns in our memory are more available than others; 
that is, some items have a greater chance of being recalled 
than other items have* 



# Therefore, even if we sample from the entire population , not every item 



has th^same chance of being' remembered 
memory is' not random * , 



For that reason* sampling from 



Let us review again the list in the appendix* We now can see'why we were 
able' to remember more women's names than men's names, that is, why our sample* 
was biased. For the purpose of demonstration, the list was compiled fefe*in- 
clude names of very famous women, whereas the men listed are less well known. 
When asked to recall these, ve were able to remember more women than men, be- 
cause being better known increased woman's recall chances in comparison with 
the men's chances* * f 



Eamiliar, well-knowq, and prominent items are more availabler 
in memory thdn -items not having these qualities* 



*Another feature ot, memory is' demonstrated here* If we return to the 
original .list and the recalled one, we will realize that it is easier to re- 
call both the beginning ^nd the end of it thaU the middle, that is, thh items 
at both extremes are, more easily recalled than the middle items* Several ex- 4 
p la nations have beep offered for this phenomenon* Some researchers think that 
fewer factor^ interfering with recall exist for both the first item on the 
list (before which there "are no items) and the last ,pne (after which there 
are none)* Xfi contract, the middle il^efns interfere w^th each other* Others 
belUerve we ar'e.more attentive to *the first and the last word of a list than 
to words in the middle of a list* Still others say that the last words in a 
list are .closer in> time to the start of recalling the l\st so they "do not 
have time" to be forgotten* 
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The fact thtt/jfre recall recent it* 
Remember, many/ more events that occurred, 
'than .things' that happened long ^go (proyi 
the .same, ltoportance % ta us) However* high 
^.knpwti Events tfeat occurred in our tferaote 



eventually* 



is familiar to us.' Usually we 
cently (a few hours or ( daye ago) 
id that they all share mow or less i 
important , impress ive , or well- 
\£. will still be recalled j 



1 f ^isfeSture of m£mory™the tendency. ta recall initial and, even more, 
+ recent things™means, in the present context, chat, the cliances df recall are 
not; equal for- £ll of the'^itfems ♦ ^ \ \ , : p 

■-v 



Ite^s, that .were first pr last in a cert^n context are'mo^e 
'availably ,iri memor/ than other items* ■ * , *^ 



.We- return now to the'two questions presented* at the start of this' chapter* 
Mere ^our answers correct? * ■ . \' ^ „ 

When answering the first question, you decided that there are more? words'" 
beginning WyLtfi the letter M than wordstbeginning wfth' ttte letter Q* This is 
correct (compare; the number of *pages ,of M words litany English dictionary with 
Q words) ♦ If all the words beginning with M : and those, beginning with Q were * 
equally kpow^ and familiar to us, they all hatj.th^ s£m? chance, more or less,' 
of being recalled* Given that in the Erfglish language there ate* Ifi fact,* -\ 
more words beginning with M, no jwonder we recalled more of these, than those 
beginning with JO and then drew the'correct .conclusion*, \ 

. How, regarding the second question*, it is incorrect to" say, that there 
are more words beginning with R thak those in^whicli R is the third letter * 
There are more words of the second type* > Why were we mistake?!; tffiy*di"d we- r . \ 
create a biased sample? Why did our mestory in^thisjcase fail us; that is, * , 
why did we recall more words beginning with R than words -with R 4s tfle tfiii^i * 
letter? , ' 



It did not happen* because Qur knowledge of fhe'English language is im- 
perfect* It happened because of the method we used to think of .-instanced for 
the sample < relatively easy to search for a word beginning with^a cer* 

tain letter* Usually we pronoun9e that ^letter yd try to add various other , 
vowels (and consonants to it until we construct a meaningful, word* ^Xt is much 
harder to do when looking for words in which a certain letter appeal's, in the 
thirS position* (Try to do this and you will realize the difficulty**) Here, 
ag^fcn, not evelry word has an equal chance of being recalled (that is, being 
included in the sample) . * * " * * 

The method- we use for searching our memory affects which items are re- 
called* Sometimes that method' is chosen for canveMence, as when we try to 
form M words by thinking ma* ♦ * ; me* * ♦ , etc Biit 'there are a* variety of fac- 
tors that determine the seatch method we tjse^. 

- ■ ■ ' .• . . >.•••• 



lcluding beliefs arid wishes* 
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Instead of checking a random sample for the purpose of ascertaining the 
truth of a specific hypokinesia or belief jfHat we hold (for example, to see 
tfhe'ther in random samples of Sc'ots and Irish the percentage of miser Scots is 
Higher than the percentage of miser Irish), our belief itself dictate^ the 
contents of -the sample; We quite easily remember instances confirming our 
belief and hardly ever-, rejpember instances, disconf irmin£ it, even if the hypo- 
thesis is, in facty false. If we strongly believed that the Irish were more 
miserly than the Scots ti we woul£ find it easy to remember instances confirm- 
ing that view; it would be more difficult Jto find contradicting ones. 

This tendency of rdcal^ing mostly confirming instances is one of the 
rtfots of prejudice, stereotypes* and incorrect images people hold in connec- 
tion with other natiojns, ethnic groups, and so on. 

^Obviously, we cannot always base our generalizations on extensive scien- 
tific studies of the entire population, but at leasVTte ought to base our be- 
lief s on random samples, rather than sampling instances from memory, which is 
biased toward confirming, our beliefs. 



Items that confirm our "hypothesis are more easily recalled 
t|ian Sterns that contradict it, . 



1 Another .reason that some items are xecalled easily is because they are 
vivid, 1 dramatic, or Emotionally laden- 1 , 

'** * * * 

1$ it true that mo^t bus drivers, in the city 'are discourteous? People 
who hold this vijew will }be deeply impressed by any impolite reply of a -bus'--; 
driver and will remark, ("Another rude bus driver," They may tell this- to 
friends or even write aJ letter ab$ut it to a local newspaper* Each such 
event will be, very well remeqbered* However, numerous other cases of riding 
the bus without encountering rudeness are forgotten because. they *are not 
dramatic or vivid; nothing happened worth rememberings ■ ' 



1* Not** 'all items' have/the same chance of being stored in Qur 
memories,, ^ f , , r ". 

/ ■ ■ *2, ■ Not ^all" items' that have been stored iiv our memories have r " 
the same chance of being recalled.* _ * /" ' • 

3, The most available d-tems, those having the Highest chance 
■of being recalled, are *, < ' " \ 

. ■ f ' 

• " Weli -known, familiar^ and prominent items (du$ .to either 
^fcheir, general importance or personal, ,relevanc e) 

j Items recently, stored iru memory, ... 

* „ ' *** • 

• Items we 'remember be&ause'they qonfirm ouf preexisting 
beliefs, ant! * ■ 

- 

• Ittms that are vivid, ^ramatic, ot emotional,* 
* ■ * 

\ ' Sampling from memory, theri, is not random safipl/ing but sampling 
according to availability . Hence, there is a 'considerable *chance . - ^ 
that samples created ^rota memory a^e 'biased. 



Is the Chance of Any I tern ^Independent of -the Chance of Any Other? ' 

- * * ■ * 

The second requirement concerning the randomness of a sampling method is 
that 'any i-tem f s chances of b£ing selected should-be independent of the chance 
of any other iten^X In other wjprds, after one particular item is. selected, - 
there.shoi^ld b*Q no change in the other, items* chapces ofbeing selected. 

Does memory operate in this way? Studies of memory suggest that to an 
extent, human memory operates in the 'opposite way* We recall a" fact or eveyat' 
because remembering something else triggered it, (that reminds me of**,)* 
Our memory often functions by wa^ of associations. Recalling one item 
causes thfe recall of another, that is, the former decreases the jrecall chance 
of yet .a third item, because it diverts our attention to a different thinking 
path* / f 

* If we return r £o the list" of nteajiingful and meapingless^ords in the 
previous section and the sample we were able tfc recall, irom it, ve will 
ably Realize that/ in addition po /recalling more meaningful^ words* those # 
y w?jo' recalled the wor3 ♦'cold", alao r^^lleS the word "warm" and vie* vers 
Usually, either both or neither wfere recalled* That'is to *ay, recallin 
of the two words increased the chao<3& of recall f or ihe seconds * . 

/ ' . \ 

Similarly, those of us who c&allid fj:om the Ust in the appendix a i&me 
of a famous actress (for -instant Elizabeth Taylor)*very likfely recalled 
another' actress <Marilyn Monroe)* <" * *. - : 




' Again, thereforevjsampiing from Memory does nob\f;ollow the requirements 
of /random sampling*. principle of associative recall, which determines tc, 
a considerable extent^ what<«we will recall netft, constitutes a x contrast to the 
principle that; any item' chance' of recall should^ be dude pendent, of the 
chances, of other items. * ■ * , p 



'In sampling from mpmory^ a specific item's chances of being 
recalled are' often dependent on the chances of other, items* There- 
fore* sampling from memory is random; ther% is a considerable 
chance that the recalled, samplfe is a biased one* * m . 9 • 
: — = — f * ' v . : — 



If sampling 'from memory is no^ random, there is no advantage, of course, 
to sampling many items* "The*chances of tha sample's being representative are 
small* 

Even : in the ideal situation, which rarely if eyes exists, in which sam- 
pling from memory is random; there is an additional drawback lowering the 
chances that the restating 'sample will be representative* Samples Jfrom memory 
are usually spall in size", either because, people dp" not remember much, or be- 
cause '-they do not bother 'to* take the time to recall many examples. A imall 
sample has few chances of £eing representative, even if it has been randomly 
selected. . , 
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* 

Memory Capabilities— Positive and Negative Aspects 

Since sampling from memory not random, should we change our memory 
habits? That would be nearly impossible to do, for this is the way the human 
mind functions* Moreover, looking closely £t these capabilities, ^we soon re- 
alize that even if we could change them (for ^xample, to train ourselves to 
recall practically every item of a population^, it would not be -worthwi^le* 
Memory is, a ^valuable tool that serves us all our lives* We are ^constantly 
bombarded'by vast quantities of information^ far more than we can stor«e and 
remember* Many things enter oun minds (and our memories), but most of them 
fade away ks if they did not exist atyill* The human brain acts according to 
the "availability principle" for efficiency and Convenience* We remember 
things that are important to us,^ things that are prominent and familiar/ 
"Insignificant things disappear from our memory* 
* 

* It is good that we t forget insignificant details and remember impor- 
tant ones* * 

A* 

* It is good that we remember people we have m^t several times and 
forget those we have seen only once* 

* It is good that we recall things that have impressed us, no matter 
what the reasons, aijd forget the rest* 

Imagine wb#t would happen and how we would function if we reineobered only 
k small and constant portion .(according to our memory storage capacity) in a 
completely raridom way* * 
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Qiir memory, like other human abilities, is a mechanism facilitating our 4 

functioning/ In most cas^s, its capabilities enable us to function effi-, 

pieptly fend io adjust to -o\jr environment.-. Sometimes, however, memdry can 
mislead and fail us/ " * * 



,Thus, we r sh0bld not modify our memory and its capabilities, but we ought 
to be jaware of 4;hem*,to te able tQ. evaluate the quality of our "memory prod- 
acts." Tn this contact, the 'products are ''samples from memory." 
■ . r * ' - ^ . • ■ • " ■ 

* Sampling from memory *is i vpt random, a#d therefore the resulting sample 

( .is usually unrepresentative, "We jpught to remember this and to view estimates 
an<K conclusions based oh sampling from memory with appropriate skepticism and 
.^caution.- We need to'a'&k ourselves repeatedly, "Do I have any reason to sus- 
pects that qy* sample! ^.s. biased?" Specifically, we should think in the follow- 
ing directions/' f 

¥ . . ^ '• ,t , • 

1. Was the sample drawn from th£ entire Relevant population or from a 
subpopylation that is unrepresentative of the total population? (What is the - 
percentage, ftft instance, of people in your age group throughout the country 
who are regtjl^r churchgoers?, ]You definitely do not know all your peers in th"e .* 
wfioie country* and therefore you cannot sample from this huge group. You 
sample from your friends; are they representative of the entire population * 
of people' your age?) "'■».'. - 1 

2* Is it plausible th|J: nty sample' is biased fbr the same reason? (Does 
the facfthat 1 attend church affect the availability of other churchgoers 
when I sample from -memory?) 
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If it is plausible" th&t.the sample X'chose is biased, can the direc- 
ts bias b'e reconstructed? (Will churchgoers tend to know and remem- 



tfon of its 

,betf more churchgoers?) 

If we -decide that our sample 'is biased $i will be justifiably less cin- 
~ fictent in^ the resulting estimate If w$ are iible to guegs the direction of 
ttie, bias, pethaps w£ will be able to correct cur ^stimat^ In any case* we 
should bfi cautious and thoroughly check sampled produced from, memory, because 
*they are not selected' randomly but rather by iyailability / \ 4 . 



Exercises 




t r * -Following are several incorrect statement^, fry to;.descr£be circum- 

stances under which the principle of availability generated these statements* 

* 1 Example r Statement: The chancqs 6i being! involved' in a c?ar accident 
: * at a p^r titular crossroad tare t very high, ^ 

Possible circumstances: .Thfs statement^ waslisade by $ worker in a gas 
, statiott Tocatfed at that crossroad* * He saw two accidents happen in the same 
■ wfeek. Is this week representative of the whole war? . • ■ # * t | 

*.■ *_ t • ' • The percentage of "smokers is steadily increasing. 

. ' • v • . . .\ ■■ * , \ J. II 

* -All' geniuses are Somewhat mentally disturbed. . *„ . . 
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• Three-quarters of young people finish high\school. 

• Every fourth person is accused t of some cjrime at least cmce in 
his or her life. * , * \ 

• Relative to their nuiiber, female driyers are involved more pf ten 
in car accidents than male ^rivers are. 

* * * ■ * 

• Each time I prepare really well for an exam t T.t gets canceled* 

• The weather is usually nice on weekends, 

• Mishap^ "usually occur in threes, ^ % *> 

• There are more of £icials *who treat' the public in a.highly negative 
way than officials who are exceptionally polite. 

* * 

K • Buying large packages of ariy^ produce is always more economical 
than "buyingi smaller ones* * ' * * 

„ * * 
2* Several categories are written below, partly in code* Ebr each one 
in turn, first decipher the code-, then Spend up to 30 sefconds thinking of ex- 
amples that fit the category* . Write down all the examples you think of, In f 
the order you thought of them, then go on to the next category and repeat , 
this procedure* 1 * } 

This is the code: Each letter in the code represents the letter immedi- 
ately following it in tjie English alphabet* Tor instance, A in the c ode . 
represents B, s B, represents C, K*reptesents L, and so on; Z _ represent s~XV\* * 

• ^>eopl£ whose kzrs mzld adfhr with S. * 

• People who vdzq fkzrrdr . * s ■ < * 

• Cities whose onotkzshnm is greater than mud lhkkhnm *^Ra^ . 

• Rszsdr smaller in size than Hghn* ■ * , H * 

\ > ' 

~* • A qzmc names you would see in a fqnbdqx store. * 

* . * v 

Try to find in the samples you just produced, examples demonstrating 

nonrandom sampling for any of the reasons discussed in this chtfptel:* .For ex- 
ample^ for the last item, if you thought of toke, did you also think of PepSiv 
because of the associative link between them? m , j v 

3** How do advertising people utilize the aV& liability phenomenon? ( * 

• Find some printed* ads demonstrating the use o^ -availability* , 

• to compose advertisement slogans (In rhynies if .you like) that 
«*eate a strong association between a particular objective and' the 
product, so that .whenever the object comes to, mind* the product 
will be readily available* * * * 

. * * 
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\ # Objective 

- ii l 
enjoying a soft drink 

the health, of our teeth* v 

'.good Mcycles % < < ' f 

S^fashioii pair ^of pants " fc 

a. refreshing shower ' , * , 

an enjoyable and healthy sunt^h 

academic advancement * 

Appendix ■ * 

1* Queen Elizabeth II T * 
+ 1. BiUy.Jean King 
t 3* S£r John Gielgud ■ 

4, * Susan B* Anthony 

r - . f - 

, 5 * Dav id S tockman 

, 6, # Christian Barjiard 

7* * Jackie Onassis 

8. Joe Hill 
■9, Henry, Cabot 'Lodge 
10. Dag Haramarskjold 
XL. Archibald ' Cox . " ■ 

12, Elizabeth Taylor 



13/ Jack Kerouac . 

I ■ " 

14 ; Marilyn* Monroe 
15,' Henry\Luce 



Product 
"TASTY DRINK" 
"SNOW PUFJ TOOTHPASTE" 
"EASY RIDE" BICYCLES 
"BODY" PANTS . * 
"SCENT? SOAP l . 
"SUN" ^SUNTAN LOTION 
V WISDOM 1 1 ENCYCLOPEDIA 



16, Ceorge Harrison 

JL7, Florence Nightingale 

18. Ella 'Fitzgerald 

19* Arthur Miller 

20. Gloria Steinem 

2l* Leonard Bernstein 

22, Cal Tjader 

23 ♦ Soupy Sales 

24* Indira Gandhi 

25 ♦ Geprge Bush 

26* Pearl Buck 

27* B* F* Skinner 

X 

28* Barbara Walters 

2ft * Linda Ronstadt 
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SECTION III; PROBABILITY ASSESSMENT 

ft " ' * 

CHAPTER § u . > t 

* FROM GROUP pfltCENTACES TO INDIVIDUAL CHAFES: PART I- 

Introduction , * . * * * , 

X # 
The following are excerpts from a fictitious, radio Interview with a space 
scientist and the manager of U weekly state lottery. 

Interviewer (addressing the scientist): What are, in your opinion, the 
chances that we will succeed in making contact witfy intelligent creatures in 
outer space by the year 2000? J 

Scientist: I think the chances are pretty low, say, 1 out of 100* 

Interviewer: One? One out of l50? How did you figure out, that numbfer? 4 

Scientist: I considered all the scientific knowledge we have at present ■ 
about outer space and also the technological advancements expected for the , , 
rvear future* In addition to that, I took into account that fewer .than 20 * 
years remain before the year 2000, as well as other considerations I will pot 
specify here* Viewing all these confederations together, I felt that my 
degree of belief is best expressed numerically as a 1JS chance. 

Interviewer: I understand , that in your view, ii's unlikely that we'll 

m^ke-some contact with- Intelligent creatures In' outer space by 2000* Still, 

I do not completely understand your answer* Why do you a^y 1 chance In 100 ^ 

rather than 5 or 10? How did you reach that particular number? 

Scientist: To tell the truth, It is hatd-fpr me to explain precisely 
wtiy I said 1 and pot 5, for instance* My difficulty i# not due t to your or * ^ 
your listeners' ptfSsible lack of understanding of fche^. scientific evidence I 
considered* It's just.that I can't really specify the process I used to $ v 
arrive at ray answer; 'It wasn't an exact aridhmetlc computatipn involving * 
addition, multiplication, or dlvisiPn of numbers* It: was more like an edu^ 
cated Intuition, the only thing I can say Is th£twhen I t cqmbined all the 
information at my disposal apd considered the 'dH thing over and over again, 
I had a certain feeling that*matches the number^^u^of t 100 rather than 5 or 
10 out of 100* 5 

r . - * 

i 

Interviewer: If I had referred my question, to one. of your colleagues,. 4 
do *you think his or Iter inner feeling concerning this Issue would be expressed ^ * 
by the same number? * * * f 

* . ^ 

5 - 

Note that the seientist is actually saying that he would ifaVe been^ indifferent 
had^ he been given the choice between fchese -two gambles: (^) winning $1,000 if' 
some contact is< established with creatures In .puter space by the year 2000, 
Versus (2) winning $1,000 if the pointer In the chance circle lands on the' 
shaded area, constituting 1% of the ^circle area (see chapter 4)^ * . 
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'-Scientist: I have £ colleague working closely with me*' ,She shares th^ 
sam$ information that I have; but mo&t probably she would translate that in- 
formation to different feelings about your question, I believe her reply 
would have been 10* out of 100. , ' 

Interviewer: Thank you very much indeed. (Turning to the lottery m£n- 
< ager) Yesterday my wife bought a lottery ticket of yours. What would you say 
^ her chanced of winning the grand prize arte? ° *> 

Lottery manager: I think she.has some cfiance; for instance, a week ago 
1 af woman in PittsFurgh won that prize. 

Interviewer: I know she h^s some chance, but can you, tell me how "high 
* the chance is? * * . 

Lottery manager:, Of cpurs'e I can. This week exactly 800,000 tickets 
were sold. * We offer many prizes, but only one ticket wins the grand prize 
each week. He^ce, the chances are 1 out of 80Q,000. 

Interviewer: My wife's chance of winning the gr^nd prize is, then, 1 
\>ut of J800,000? ' * 

* ^ * 

* tottery manager* Yes, exactly. 

If we ^check the answers of the two in/^rviewees, we realize they reached 
their answers , in different ways. The scientist considered the entire infor~ 
mation at* his disposal, and thereafter a, certain inner feeling evolved which 
he translated to a specific number. It is hard to describe in detail the ' 
process by which the scientist translated tils considerations and knowledge 'to 
a feeling, and how that feeling was translated to a number. He emphasized 
^ the difficulty o*F describing this process in detail. He added that Jhis col- 
league, who shares the same information Concerning the subjecjt under discussion, 
would have reached a*larger number. In contrast, the lottery manager coulcT^ 
* produce the number she suggested quite^easily by a dftrect calculation from> the 
information available to her: * 

1. She knei* how many tickets were sold (8*00,000). 

2., She knew how many tickets the interviewer's wife bought (pne ticket?). 

v 3, She knew that one ticket wins the grand prize. 

' I > - , * ■ . ■ 

« * 4. She is familiar v/ith the lottery method. This is a random method in 
which every ticket has exactly the same chance of winning. 

N - From these four information* items, the lottery manager drew the dimple 
arithmetic conclusion concerning that chance: 1 out of 800,000. 



There are cases in which obtaining a number from the information 
at our disposal is done in a direct and obvious way accepted by every- , 
gnegglsg / lo cdhtrast, there are cases in whi6h obtaining a nuijjber 
froift available information is a matter of personal feeling not neces- 
sarily shared by others . m / 
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In the fourth chapter we* dealt with cases of the second type* ■ We pre- 
sente4 the device of the chance wheel, which we used to help us in producing 
s *a number* We will return to similar cases later* This chapter and the next 
. one deal exclusively with cases in whi^h the available ^formation is used 
' to- produce the number in a direct, obvious, and accepted way* We will see 4 
the features of s'uch bases* and how information^ can be translated to ^ number 
r expressing the chances* ^ * 

, Example : There are 40 students in £ particular class in law school, 30 
men and 10 women, * If you are asked to bet who will enter the classroom firfci; 
next Monday morning, will you say M a man 11 or "a woman?" (Assume that you * 
have no additional information ooncernfSjg either the topic of the first Mpn- 
day piofning class or the habits'of the women and men in that particular class*) 
A clever gambler will obviously bet <|n "a man, 1 * since there are more men than* 
women in the class, and therefore the chances that the, first entrant is a man 
are greater than t^hat the first entrant is a woman*^ ^ * 

Let us 'xecb^dk the data: There are 40 students in, the class, 10 women 
and 30 men* Here is a new expression, "f requency"; its definition is as 
follows^ - ♦ > 



■ J • 

Frequency « number of cases (items) in the groiip* f 



Hence, the frequency of women in the class ^s 10 and fche frequency of men'is 
30* ^ * 

A smart gambler will .bet on a man because the frequency of men in the 
group is *greaKr than the frequency of women; thus* the chance" of the first 
^entrant being a man is greater than the chance of the first entrant being a 
woman. , * 

(* : " ' . ' \ 

To what extent, precisely, is the men f s chance greater than the women f s? 
If we wish to express these chances numerically, as percentages;* within the w 
range of^O to 100, vh&t numbers will we use? Obviously, the men's chance will 
'be expressed by 'a number larger than 50, for the* men have a greater chance - 
than the women and these two are -the only two possibilities* % * ^ * 

There are 40 students in the cla^s* A quarter of them (10 divided £y 40) 
■ are wonfen, and three-quarters of them (30 divided by 40) are men* When these 
A- proportions are expressed as percentages, * there are 25% wdmen.Ca quarter multi- 
plied by 100) and 75% men (three-quarters multiplied by 10Q)* Together they 
< make 100%* ' * ' 



6 * * f 

Ev«n if such a gambler loses the bet, becduse the first entrant happens 

to be a woman, nevertheless his or her decision is still cXeyer* ?This is a , 

situation of uncertainty* and either result, the more expected as well as the * 

less expected, can occur* In other words, a good decision can end in an unr 

desired result * < 
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^ k smart' gambler will figure that' the chanced of the first entrant being 

a man -are equal t6 the percentage of ffllsn in the classi 75%* And the chances 
that the first entrant will be a woman are 25%. There are three times as jnany 
nien,as women, and this ratio holds also for' the chances: The chance that the 
first entrant will be a man is three times as great as the chancef it will be a " 
woman* ' 

If .we ask the same question about another class consisting^ of 42 students, 
24 women and 18 men, the chance of the first entrant being a woman is about 
57^% (24/42 t x 100), as is the women's percentage, and tjie cha^P* it. is a man is 
identical to the men's percentage^ about 43% (l8'/42 x 100), . \> 
* " *■ 

, The chance of 1 tltfe first student entering the classroom being a man. was' 
_ determine*} directly by the class* composition, the composition of ithe group 
under discussion* In the next section, we will* discuss the relationship be- 
tween the chances for a single observation of a characteristic in *quest ion' 
and the percentage of that characteristic 4n the group as a whole. 

From Group Percentages to Individual Chances ^ 

First, let us do .a simple experiment. X have an ordinary thufiSTtack* 
What is the chance that if * I drop it on t£e floor it will fall head down in 
contrast to falling on its side? If I drop it onc&} either one of these two 
results can occur; therefore, a single trial wilr notr teach us anything, about' - • 
'the "relevant chance , * * 

But suppos%we throw the tack many times and calculate the percentage 
of trials 9n which it fell head down out of al^ the trials (number of throws)* 
tt the tack showS more side falls than hea<fr-down falls, if will be possible 
to say that /the change of a side fall on a single throw* is greater than the 
\ chance of a head-down faj.1 * Since thesg are the only two chances possible, 
th£ chance of a side fall would then be higher than 50%* If. the tack fell 
ori/its side, say, 75% of the time in dhe trials, we could be even more 
accurate by saying that the chancd of a side fall in a single throw is about 

Such ao experiment was carried out; a tack*was thrown many times. Once 
in a while (afiter some throws) the results up to that point were .recorded in 
the followiog manner: ^ « * * , 

1* Number, of current throws (the first column in Table 1)* > 
* * * * * 1 

2* Frequency of head-tfown -falls, namely, hovmaoy times up to that 
point the tack has fallen head dowrtf* (the second colunpi) ♦ 

3* The percentage af times the tadC fell headf'rown out of the total 
number of, throws to'that point (the third colump^iLTras column Vas obtained 
by dividing column 2 by column 1 and nniltiplying by lflj): ' 

column 2 ftn grequeqcy o^head-dowh fallal lftft 

column 1" • Total numVer of. throws 1UU 
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table 1 > 
Frequency and Percentage of Head-Down Falls 



"Column 1 




Column 2 








Colutrei 3^ 


' 4. 


■ * * 
Total t number * " 
of throws 




Frequency of 
head-down falls 






Percentage $f 
hteatd-down falls 


i ; ' . 




* * 
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100 = 


100 


2 S 


t 


. 1 - * 
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X 


100 - 


50 


5 










2 ' 
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X 


LOO = 


40- 


10 
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3 






_3 
10 1 


X 


100 = 


3b 


" 50 




i 

8 ' ■ 

* 

14 






* 8 

30 

14 


X 
X 
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-100 — 

' 6 
100* = 


26.7 
28 . 


100 




30 


- 




30 

100' 


* 

x"100 - 


30 
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• 200" 


\ 








80 
200 


X 


100 - 


40' 


300 




118 


* 




118 
30ft* 


X 


100 - 


/39.3 


400 

**> 




160 . 




»t 


160 

3oo 


. X 


100 = 


43 


' 500 




' 202 






202 
500 


X 


100 ,= 


40.4 


600 




241 * * 


"( ■ 


-V 


241 
600 


X 


100 » 


40.2 



Obviously** if you were to repeat the entird experiment* yoiw table of " 
results would be slightly different* Fo^ instate ^ the first/t^row could 
have resulted in a, s,ide fall gather than a. head-down fail* atid then the per- 
centage of head^down Jails in that, throw wqul4, have been 0%* \ ; 

Ea&h xoyt in the .t^ble is one 'sampler of thr<Ett& ou'c^o£ ^an infinite number 
of/possible throws* /; f £ "\ W-'**; ' 

V r * * ' ^ £ * x - 

. the $iix4&<m sji6vsj,the results o£ a sample' a| five throWs/ twice the 
tack fell hqad down; the corresponding percentage is 4o%* In the seventh row. 
a sample of 100 throws is rjacordirtl^^f which 30 were head-down falfs* for a 
percentage of 30%* ^ . t . - - ^\ \ ~ 



g ^The total, population we^i^lnt£resfed in is the ^population of all possible 
tarows of the thumbtack* E*£h row of the table is a raftgom sample (see chapter 
6,,Jtandom Sampling section)* from this population because jf v 

. £* Each possible throw h*s an. equal chance .of inclusion in the sample/ 

2- There is no connection whatsoever between one throw and another* 

We have learned that the chances of *a random sample's being representative 
increase's the size of the sample gets'larger* Let us suppose that the tack 
has the same chance of falling either head down or on its side* Is it plau- 

, sibla to obtain, in a'sample of 500 throws, 50 head-down and 450 side falls? 
It is" very unlikely* However, is it possible in* a small sample, say five * 

m - throws, to obtai^four side falls and ^ne head-down fall? This result is' 
ifiuch more likely* 

We realize, therefore, that if we want to rely on^ the result^ of dur tack 
throws in order to say something about the chances of landing head dQwn or 
side down, it is worthwhile to have a large sample of 'throws* Such a sample 
has a much better chance than a small sample of representing the features of 
the tack falliitg* * 

x ; 
This familiar effect is clearly demonstrated in Tablfe It In the small 

samples, tfce percentage of head-down falls is highly inconsistent , 10Q%» 50%, 

40%, 30%* etc* As the sample size increases, the percentages Stabilize: 

39*3% (300 throws), 4J% (400), 40*4% (500), and 40*2% (600), 

r If we continue the experiment and ttjfrow the tack 800 times and*even more, * 
we will realize that the percentage of head-down falls will hot change much* 
The percentage of head-down falls stabilizes at around 40?* We can now say 
^ that the chances of the tack falling head down in one throw are approximately 
40%* because this has been tfte percentage qf head-down falls in a large number 
of throws • 



P We infer the chance of a specific outcome (e^g*, head-down 
fall) in a single trial from the .percentage of that outcome in 
a large number of trials (a large sample) ♦ ♦ , 




Another experiment demonstrating tfre same conclusion was conducted by a 
statistician named ftao, He put 10 ball* into a sack, The balls were identi- 
cal in ^hape and size but *not^ in color: Five were black, three were white,-'*" 
and tpfc> were red* The question was, fohat,is the chance that a ball removed, 
-at random, frjtgf the sack' will be black? In order to answer this question, Rao, 
withoujt looking in the sack, tooR o^t one ball, wrote down its color, and' 
returned it to the sack * He then stirred the contents of the safck thoroughly* 
He repeated this procedure 1*000 times '(this Is like throwing a Jack 1,000 
times), and every once in a. while recorded, the following three data (as we 
did with the tacfc),! * t , 

• Number of balls taken out to this point (sample size), 1 

• How many balls were black (frequency of the Outcome "black 11 ) , and 
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• The percentage ofblack ball retrievals to this point (the percentage 
of the outcome "black")* ' 

Wh£n h^r finished the experiment, he realized that as the size of the sam- 
ple (number of retrievals) becamfe larger, the percentage of black balls 
stabilized at about 50%* Rao's conclusion was ^ that the chance 4 of retrieving, 
one black ball from a sack containing 5 out of " 10 balls is 5Q%* « . 

4 Let us assumetthat we are asked to answer similar' question: If I take 
out ball*from\a $ack having similar content of balls, what will be the 
color of the ball? Obviously, we cannot answer this question with certainty* 
This is an uncertain situation, for three diffe££Pt outcomes (black, red, and 
white) are possible* Nevertheless, we tan answer tfhe * question probabilistically: 

1* We will prepare a set of ekhajgistive and mutually exclusive possibili- 
ties. The set is black, red, and, white* This set is exhaustive , for there 
are no other balls in the sack** The possibilities are^fautually exclusive be- 
cause no ball is painted with more. than one color* - t 

2* We will assign' chances to the various possibilities* Rao's .experiment 
told us that the chance of a ball being black is 50% (because in 1,000 re- 
trievals the percentage of black balls stabilized at aboujfc'50%) * 

Hf(l we also counted, at each point, the numbers arid computed thfe percent^ 
ages of white and red baJLls, we wpuld have seen that the percentages tended 
to stabilize around 30% white affix 20% red, Herw?^ the chante of a single 
ball being white is 30% and that of a singly ball being r£d*is 20%* 

> The chanoes which we will assign to the different possibilities are, 

. v * ■• * * 

then, ' *y * 

jr black white red i j total^ 

"50% ' 30% , 20% 11 100% 

The sack contains a -group of ft 10 Items, identical in shape and size* 

The chance of any one item being sampled- in. one retrieval is equal to - th'e 

chance of any other item, pcecj-sely because of this sameness ixf shape* and - 

size* Each one of the 10 balls has exactly the mme chance* % * ^ 

4 

* We have seen- that the chanoe of taking out a^red ball, 'fot example, is 20% 
(according to the percentage of red ballrf in many retrievals)* We also kn9w. 
that 20% jof the balls in'the sjick are red* £s the 'identity of theae numbers a 
coincidence? .Is it f only by accident that the percentage <3fo:ed balls in many 
retrievals is identical ,to the percentage o£*red balls in thfe sack? No* 
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. In a sample of 1,000 retrievals, for instance, the percei^tajjes of black, 

red, and white balls should, obviously, add up to 100%* Similarly, this will 

be the base in any .other sample* In a set of mutually exclusive and exhaustive 

r possibilities, *the degrees of 'belief based on sample information will a^ up 

p to 100% across the various possibilities*. . . \ 

" • v . • ■ ' • • ■ . . ■ 

* * 

• .."■» in ' "" • * ■ 
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The chance o£ retrievihg £ ^e'd bali:(a chance we figured out 
by computing tfie percentage of % red balls in a large sample of re- 
trievals) is exafe.tjy the sam6 as the percentage of red balls in the 
ack— 20% > ♦ . \ 

' - * / 
/ i 6 TJie 'chance of taking out! a black ball (a chance we figured out 
* by* computing the 'perc£ntajge;of black balls in'a large sample of re- 
trievals)' is exactly the sztoa .the percentage^ black balls in 
thai .sack— 50% * ' This rule applies also to; the-white balls* 



' This lawfulness exists only if all the balls are identical in shape and 
sij&e, ^for only then dcfes each ball ^have the same chance of being •sampled* 
If, fo£ instance, the red balls are bigger than the other balls, then in 
eyery^aiifpling^ their chances of being picked would be greater and in a large 
sample (say 1,000) there^would have been mor^ than 20% red balls, their per- 
centage in j£he sacl$,, But if all balls have the same chance of beings sampled, 
the. percentage "of a certain color in a large sample is equal (approximately) 
to the percentage of this color among all the balls. Furthermore, we pre* * 
viously inferred the^chances of 'drawing just one ball of a given color from 
the percentage of £alls of that color in the sack* 

We can formulate all this as a more general rule: 



/ 

jf~ — : : ~^ 



*+' If all items in a* group have the same chance of being sampled, 
tBen the percentage of a specific characteristic in a large sample 
is equal to the percentage of this characteristic among all items in 
the group* , This percentage is also equal to th£ chances, that the 
specif ie<Q#haracte riff tic will be the outcome when only one item is 
sampled: [ 



iff tic w3 



Let us review the former examples: 

1* It is clear now why in a class consisting of 30 men and 10 women 
the chance *tha( th^first student entering the classroom will be a man is 75%: 

* ■ . X ** i * 

* 4 

* Let us assume that every morning, each one of the students has 
t^e 'same chance of being the first to enter the classroom, 

•* If we had checked who was the first to enter every .moaning for a 
long period of time, we would have found that for about 75%*of the 
mornings it_wirs a man* This is because men comprise 75% -of the 
class* * \ 

^ * This percentage is also the chance that we will assign to any single 
_ moaning in connection with the question under discussion* We will 
say that there is 75% chance of a man being the first to enter the 
' * classroom* . « ' 
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2* It Is also clear now why the chance of the woman winning the grand 
, ,prizfe is 1 out of 800,000* \ * \ , 

■ * There- are 800J300 tickets (like 10 balls in a sack), only one of which 
will BeCthe winner (like 5 black Kails) , What is. the chance that the poman 
'who bought a single ticK&t is holding the winning, one (like the chance that 
in a Single ^retrieval we will pick out a fclack ball) 3 The chance in percent- 
age terms is ^ > 

* - » * * "* " 

x 100 - p * 0*0ft0125% 



300,000 8,000 

What is, then, the common denominator of all three problems? * 

. • ..JjThe chance -of picking out fiT black ball (balls in a sack)? 

* The chance the first student entering the classroom is a man? 

^ • Th^ chance of 'winning the grend prize (lottery)? 

1* In all ^these problems there is a defined group having a given size 
( 10 balls in a"sack, 4£ students in a class, and 800,000 lottery tickets 
sold in a given week) * ~~ * 

2 + A' question is asked concerning the chance of a single specific char- 
acteristic , or result (a blacfe ball, a male student, a winning ticket)* 

* i. * i 

3* If we sample randomly one item of the group, t±en each item in the v 
group has the same chance of being selected (each ball, each student, or each 
ticket has" the same chance)* ^ 

4* In order to compute the chance in all three cases, we check 

• The size of the specific groufl (10, 40, 800,000 for the ball v , 
classroom, and lottery questions, respectively)* 

,9 The size of the subgroup having the relevant characteristic (5, 
30, 1), and 

The percentage of the subgroup in the entire group (50%, 75%, 
0*000125%)- 

This percentage is the chance we assign to the question concerning the 
chance of a dingle item's having the relevant characteristic* 

When I waa^ visiting my family in the Midwest, I met a young man, George, 
who is a student at. Midwest University (MU)* Later, my family and I had a 
vigorous 4iscussiotf' about the use of marijuana on U*S* college campuses, and 
I began to wonder whether George, the young man I met, smoked marijuana* 

■ * - 

I could not answer that question conclusively; indeed, X knew very little 
about George,* having met him^only briefly* But I wondered about the chances 
that* he is a dope smoker* Row could I compute those chances accurately? 
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I ought to define both the appropriate group/and the relevant character-* 
istic* Here the appropriate group Is * * 



f t All male students enrolled at Midwest University: - 



Defining the relevant characteristic requires & little more care; what / 
exactly do I mean by "dope smoker?"* Remember/ I must .satisfy the clairvoyance 
test in tjiis definition* My family and I decided aft^r some discussion that 
dope smoker meant ~ > * /, ■* 



petson w&o has smoked or otherwise ingested marijuana at least 



once every Z weeks for the last 6 months* 
The relevant characteristic is then 



r 



• A mile student enrolled at Midwest University who is a dope smoker* 

Sote that the relevant characteristic jfs always definW as a subgroup of 
the appropriate* group* * 

V * 

Now that our group and subgroup are carefully defined, we need only obtain 
the appropriate data iij" order to calculate the percentage 

t Number of.,male* MU students who< smoke dope - 
f * Number of male students at MU 

I will use this percentage to express my belief that Geofge, about whom I 
know nothing else, smokes dope* 

When we have the relevant data, it is simple to compute the chances* 
However,' in most interesting and important cases, there are no available data 
either on the size of the group or on the Size of the relevant subgroup. In 
such cases, we will use estimates* Sometimes we-will directly estimate the 
percentage, and in other instances we will estimate the size* of each group 
and thus obtain the desired percentage* The next* chapter will discuss these 
estimation procedures* ^ 

* ■ ' * 

* Exercises . 

1* What are the chances that the next peron you meet was born 

**t • On a Saturday? 

• On the Fourth of July? 

• On Christmas Day? 

2* What are the chances that this same person is a twin? What informa- 
tion do you need to answer this question? \ 

* * 
*3* Take a paper clip and bend the center, part out slightly, just far 

enough so tjiat it is possible for the paper clTp, when tossed, to land resting 

sideways* Now toss the paper clip 300 times and record, for each toss, whether 

the center (smaller) jfart landed ug^ down, or sideways * From these data, con- 

-struct .a table like Table 1* Because you are dealing here with three outcomes 
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rather than two, you will have to ^expand column 2 to three columns: frequency, 
up, frequency down, and frequency sideways* What^re the chances^that , on the' 
nekt to^s, the paper clip will land with the center part up? 



4*- 



4, Below are two tables giving frequency data. From them, formulate two 

questrons in terms of v chances C^What are the chances that,,,? 1 ')- Answer each 
Gf your questions i>y 

* Defining a total group, 1 



* Defining the rjaleva/it character i3tic, 

♦ t Defining the subgroup that h&s that characteristic, andt 

# Calculating the percentage that the subgroup is within the 
* total group* * 

t 

Women' in the Armed- Services, 1978 

Total military 2,0j62,000 . 

Wome\ ■ • ^*34,000 J 

Total officers ^2747000 

Women officers * 17,000 

Enlisted personnel 1,788,000 . 

Enlisted women * 117,000 ■ ' 



Total Arrests, by Age Group, 1978 

Under 15 728,198 

%J-5-24 ' * 2,808,664 

^5-34 2,111,396 

35-44 , 1,036,863 

45-54 *] 669,074 

55 or older ; 411,998 

Not" kncwn ' . 6,898 

Total' 9,775,091 



r 
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.CHAPTER- 9 ■ , ' ■ - ' 

. * ■ i * * » , f 1 ■ ' 

\ ' " n * * 

FROM GROUP; PERCENTAGES .TO INDIVIDUAL CHANCEg 1 : 'PART II . *. ". , 

The*jJse of Estimates for Computing Chances J 

Tonight. I am. going to the, theater* I have just discovered that my friend, 
Ralph, has elso bought a ticket for the show tonight* .M^ se« is. in the 15th 
row* What ^is the chance that Ralph will sit in the 'same row? 

■ " . * -k - ■' ' " 

In the previous chapter, it was shown that we can -fcake inferences about 4| ..r 
; such chances from the percentajge of the number of seats' in row 15 (except ^nine^ 
out of the total number of seats in the theater (except mine)* This is the. 4 
procedure* . * 

, '1. Define the entire group: total number of seats in the tjieater, no£ 
counting mine* * * p. 

.2* Define the subgroup; number of seats ii^row 15, Rot counting mine-* 1^ 

* * t 

. i 3* Find the „lize of these two groups* 

4. Compute the appropriate percentage': r * ** * 

Number of seats in row 15, minus 'one 

Total number of seats in the theater, minus one 

This percentage ?is the chance that Ralph' will sit in the same row that I 
do", a provided of course, that I am willing to assume that Ralph's ticket is 
equally likely to be for any seat in the theater except mine, 

* 4 

Even with simple problems like .this one, we usually do not have accurate 
.data on the size of each group; this is even more often the case with compli- 
cated and interesting problems* For instance, the chance of recovering fi;om 
a specific disease (what is the usual percentage of people recovering from 
it?); the chance of w$ friend giving birth to twins (what is the percentage 
_j6f twin births out of all births?); my chance of being accepted t^o the Navy 
school for combat pilots (what is the percentage of people accepted to the 
school out of all applicants?) * , 4 

In such cases, in tfhich the relevant information is 1 lacking,' we will use 
an already familiar method—estimation* Three estimation procedures are - 
available* 

{* 

■ t 

* 

Estimating the Size of Each Group ^ 

Me will attempt to estimate tfne total* number of seats in the theater. 
There are, for example, about 30 rows. in the theater's main hall and 30 more 
-in the balcony* By estimating the number of seats in rows located in various 
areas in the main hall and balcony, we 'reached a total estimation figure of 
3,000* * . v ' 
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Escimacing che number of seacs in row L5> tfe^figured ouc chere are 
about 50* '* - / V » 

The chance, Chen, chac Ralph will sic i'n Che same row chac I do is: 



50 



3,00Q 



ftt* 1 ~6!£ 



(subtracting i t my seat, from boch 50 and* 3,000 is noc significant, since 
these figures are estimates rather tjian che cxue values)* 
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Returning + to che probfem chac- ended che lasc chapter, how can we evaluace 
e chances thac George smgkes dope? Probably we do noc have accurate iafor- 
ation concerning the siz£ of e^ch of che relevanc groups* Instead,, we will 
use estimates* 

%, * 

1* Define che Cocal group: male students* enrolled ac Midwest University* 



)2, Define che subgroups, male scudencs enrolled ac Midwesc Universicy 
tho/ smoke dope* 

3* Estimate the size of each group*, 

4, Compute the percentage; s 

» Size estimate, of tfte subgroup x 
Size estimate of the total group 

Sometimes it will be difficult for us to estimate tHe size of ong or both 
groups. In such cases, we will use a, different method in order to obtain the 
desired percentage* 



Estimation Based on Samples /' ^ 

In this method, we estimate the desired percentages in a sample rather 
than in the entire group* For instance, X know about 20 male students at 
Midwest University** Pour of them use dope. Thus, the percentage of do'pe 
smokeas is approximately 20% (4/20 x 100). This method is convenient when 
we have no. idea about the size qf one or both groups but we can recall enough 
Examples to create a sample upon which we will base our estimates* Such a 
sample is, obyiously, as vulnerable as any other one: Are the students X ]&ow 
from Midwest University representative of all male students atMidwest Univer- 
sity? Xs the number of my student acquaintances too small. to constitute a 
decent sample? 

In the two estimation methods discussed, we compute the percentage^ either 
relying on estimates of the sizes of both groups or relying on relevant sam- 
ple??" 5 " There is another estimation method in which the percentage we sepk is 
itself estimated* 
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Direct Estimation of the Percentage 



■ Very often we estimate the percentage directly rather than compute It 
from estimates of groups or samples. "I have read in the newsjtaper that 37% 
of all. college, males smoke dope* But Hidwest University is a rather conser- 
vative university compared to, say, California colleges* Therefore, I esti- 
mate the desired percentage as being / about 25%* M 

in this case, the problem is ridt" decomposed so that, we deal with its 
elements, the appropriate two jyrou£s* Insteadf^ve estimate the percentage, 
directly , using some information we possess* We .should fteep in mind, "though, 
that 'this- is an estimate just like any other* We might be wrong in remember- 
ing what the newspapei said or in correcting that estimate on the basis of 
our knowledge of a particular university* 



We can use one of th& following three methods to obtain esti- 
mates of chances: 

1* Estimate both the size of^the relevant total grotip an4^ 
that of the subgroup; tfcen compute the percentage utilizing both 
estimates and from it infer. the desired chance* 

4 c 

2. Carry out the same procedure using a sample of the total 
group; Obtain/estimate^ or exact figures of the sample size and 
of the number of items having the relevant characteristic in tj fre 
sample ; then compute the percentages, w^ich are also the chances, 
using the sample estimates. , ^ 

3. Estimate the, percentage (the chance) directly, using some 
information available to you* 



As with other numerical estimates, it is a good idea to use more than 
one estimation technique whenever possible* When ttio different estimation 
'techniques produce greatly different estimates of tjie chances, this signals 
possible errors (ske chapter 5)* / 



What is the Relevant Total Group? 

In the examples discussed so far, we dm neOtfiave great difficulty in 
defining the appropriate groups* Sdmetimes, wlfowever, it is not completely 
clear exactly what groups we are trying to estimate* For example^ 

* < *< 

1. Mjr friend gave birth last year* What are the chances that she gave 
birth to ttf4a£? 8 ■ $ 



8 



I^t us assume that"Ve do not know whether or no£ she has given birth to 
twins in the past* ? , * 
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•2* My frieyid is pregnant $nd ^ue to give birth next month* What are 
the^chances that £he will have twins? 

In these two examples the appropriate total group is '{all births 11 and 

the subgroup is "twin births/' Here we have two problems: 

* ^ * 

■H5 * 

( Problem I t T^ e total group Is "all births" since when? This is a huge 
group* How could we count all bjirths up. to now in order to compute the per- 
9 centage of twin births out of them? We 'can overcome this- ^rol?lem by using a 
really large sample,, s^y, all U*S* births in the last dec&ie* * 

Problem 2: In the* first example, my friend 'has already given birth* 
Thus the eveht reall/ is an item from the defined group, "all births in the 
last decade*" Ii\ contrast, the second example involves a birth that has not 
yet- occurred* The event not really a member of the group we are using to 
compute the chances , 1 for the group is -of .births in 'the past, while fche event 
in the future* * , ^ * 



■X 



We encounter this problem whenever we u£e* past data to assess the chances^ 
of futtire events (Aren't these often the most Interesting issues?)* - In so 
doing, we assume that the similarity between the past cases and the future 
case justifies our 'inferences from the past to the* future: ^ 

x ' 

A friend of mine has a son who will enter Midwest University next year* 
What are the chances that he will, while in college, be a dope smoker? We 
will answer this question as we have answered the question concerning George, 
who is now attending Midwest University* When we do, we are assuming that 
the situation in tfie future In this respect (the rate of dope smoking at 
Midwest Universrl^7 is not going to change sijggif ^icantly * < 

What is the chance of at least one spowy day in Atlanta next February? 
If we believe next year to be basically similar to previous years (as far 
as winter weather is concerned)", we will us^ as a groups several February ? , 
months of the past and we will check the percentage of those February morfths 
in -which there was at leas^one snowy day* While discussing .the topic of 
estimation in chapter 6, we said that to the extent that the sample is large," , 
the chance of its being representative increases* Hence, in attempting to 
estimate chances of future events, like at least pne snowy day next February 
in Atlanta, we would do well to base the estimate on a sample of many past 
years, as many as 100* Is this always the case? 

What is the chance that my friend, who is 4 moving to atj apartment in mid- 
town Manhattan, will experience & burglary during her first year there? If 
we check Back,pn the burglary statistics for the past 100 years*. we will find 
that over time burglaries have substantially increased in mid-Manhattan* The, 
lM0s f "for instance* are not at all representative of the present (nor of the 
future) in this respect* It is better f then ? to base our estimation_on ra „ 
much smaller sample of recent years, say, the last 5 years; these years are 
more representative of the present and of our expectations for the future* ■ 
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If the relevant, total £roup is too large, it will, suf fice^to 
use a sample for estimating the chances, providing that it is n m 
plausible to assume that^jihis sample is representative of the total 



*^group . J ■ x 



When assigning chances to a future event, the estimates can be 
base4 on similar past cases, providing x that it is rea&nable to as- 
sume- that no substantial change has occurred nor will occur with re- 
gard to the characteristic whos£ chanced we are estimating* 



hanfce$*of var 



Exercises 

1, Followirtg are questions involving chanfce$*of various events.^ For 
each question; do the following: r V a * 

a* Specify the total group and the subgroup having the relevant 

characteristic* i 
* * * 

' b. Find samples representative of these 9 groups (consult friends 
if you need to) X 

* * 

c*. Estimate the sizes of ti^e samples you chose* 

i 

d* Compute the chance of ihe event in question by using the 
figures you obtaine4"~fn step, c* 

t Example : What is the chance that the next ring of my telephone will turn 
out to be a wrong number? v * 

a* Total group: incoming phone calls to my house in the past and- 
future* Subgroup: wrong .number calls* , 



b. Sample of the group: number of calls last .week* Sample of the 
subgroup: number of wrong numbers last week* 

* c* I get approximately 6 calls daily during the week and pbout 20 

on the weekends, which mkkes about 50 incoming calls weekly* 

Last week, as far as I remember, there were two wrong. numbers* 
*. t 

d* The chance, then, is: 2/50 x 100 « 4%* " 

$ere are the questions v What is the chance of : ' 

1* Finding at least one typographical error on the third page, of 
tomorrow f s local newspaper? ^ 



2\ Running oBt of gas sometime next month? ( 



3* finding a coin on the s'idfewalk during a 1-hour walk^in town? / 

4* Being contacted at least once by a pollster during the coming year? 
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Reducing the Group 

- William Smith, a high-ranking official of the Pentagon, Invited Jean 
Baker, a Pentagon security officer, to 'lunch* Following is their conversation 
over lunch: - * > , * , 

/ " Stodth: Yesterday at a concert I met a Soviet named Boris Yeimilov'* - ( 

He works in the §ovlet consulate, y Do you know him? 

* v , 

Baker: No* ' * 

'Smith: We talked during the Intermission and he Invited me to a dinner 
at his house next' week, J" * 

Baker: You don't mean you*** * * 

■ * 

Smith: That Is precisely why I wanted to talk to you. You have mote ex* 
peri&ice and knowledge concerning Soviet diplomats than I do* What Is, In your 
opinion, the* chance Yerjailov Is. an undercover Soviet Intelligence agent? 

Baker: I do not knoV Yermllov and you did not teil me anything about him, 
except that he Is an employee of the Soviet consulate here* Based on my ex~» 
perlenqe of recent years, I would say that about 60% of the personnel at the 
Soviet consulate are actually undercover agents wftose official positions are* 
secondary to ,thelr Intelligence-gathering functions * t Thus, I would estimate 
the chance that Yermllov Is such an agent as about 60%* 

Here, as In the former examples, the assessor has relied upon the percent-* 

age of similar cases In the group, namely, the Percentage of those who are- be-* 

lleved to be undercover agents, out of all Soyiet consulate staff members* L£t 

us proceed with the conversation: 

» * 

Smltht I do know something about Yermllov that may change the picture 
a little* He works In the economic delegation' at' the consulate* 

Baker: Oh, that*s different*" In my opinion, the percentage of Soviet 
spies among Soviet consulate economists is much lower than among the others* 
I would estimate ii as perhaps 25%* T^grefore, the chance that Yermllov Is a 
spy has decreased to 25%* 

We have seen that Smith furnished Baker with another information item ' * 
concerning Yermllov and that she had to define a new total group from which 
to estimate the appropriate percentage* That is, we are no longer dealing 
with the percentage of undercover spies among all Soviet consulate staff mem- 
bers In Washington, D*C*, in recent Vears but rather among all economic 
delegation personnel* This additional information item was Insetted into the 
redefinition of the groups in the following manner: 

The i total group Is all staff members of the economic delegation In the 
Soviet consulate in Washington, D*C* t '* 
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The* subgroup is all staff members of the economic delegation In the' j 
Soviet consulate in Washington, DvC*, who are also Soviet undercover infelliV # 
gence agent&* 1 * 1 

* r ' 

Thus,\the two groups are reduced* The percentage can either increase, 
decrease, or remain the same (in the present case, it has decreased)* 

* " If William Smith had also told Jean" Baker that Yermilfov flies at least 
once a month to the Soviet Union, she should nave considered two even smaller' 
groups* * t , f 

The total group itf all staff metiers of the economic v deie gat ion *ln the' 
Soviet consulate in Washington, D*C*, who fly at least 6ntei a !month to the 
US&* * . * * ' * v ' * 

■ " * . - -\. v 

The subgroup is all st§ff members of the economic delegation in the 
Soviet consulate in Washington, D*C*, l Vha fly at least once a month to Tihe - * 
USSR and who are also Soviet underground intelligence agents, ^ * 

* i ■ ' * \ ■ * : t 

■ The chance that, Yermilov* is an undercover agent is the* percentage of the, 
subgroup within this newly-reduced total group (Figure 14)* ' f - 
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♦ O Soviet Consulate, Member 

0 Undercover mlelligence • 

^ Economic Delegation Member 

rf" Visits USSR At Least Once A Mohth 

figure 14, Total group and subgroups. 
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Ftom Figure 14, count or compute eacfwof the following: 



a* 


The 


b * 


> The 


agents* 




c * 


The 




> 


a. 


The 




The 


spies . 
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f * The percentage of ageftts in the Soviet economic del$g&tion* " 

1 . ^ 

^ g* '.The i^Cmiber pf economic delegation members who fly to the USSR at 
least once a month* w 

h* The number Qf economic delegation members who fly to the USSR at 
least once a month and are also intelligence agents* . ' 

i* The percentage of agents put; of all Soviet economic delegation 
members who fly to the USSR at least once a month* 

,. - . , 

With each adSItional ♦piece of information, the total group gets smaller 
U versus d_ versus jj) and the j>^ rcenta S e °f intelligence agents in the group 
changes Cc versus f/yersus ±) from 60% to 25% to 33%* The change in the per- 
centage indicates that the additional items of information, "he is in the 
economic delegation" and "he flies to the USSR at least once a month, 11 are 
relevant* « ^ J 



The Relevance or DiagnosticjjEy of Available Information 



4 It is worthwhile to use additional information to redefine 
the groups involved* Each additional item of information dirain- ^ 
ishes the size of tdth the total* group and the subgroup; it may 
also modify-J^ie^estimated chances V^nificantly* * 



Is it useful to take into ~aceouft£ each piece of information available 
to us? 'Should we consider, for instance, the fact that Yermilov is fcomplrffcely 
bald? 'Let, us define the appropriate groups ^accordingly; < * 

* - ■ 
+ * The ^otal member pf econ6mic delegation staff members in the Washing- 
ton/ D*C*, Soviet consulate who fly to the Soviet Union at least once 
^ ' N a month and who have bald heads* 1 ft * 

* # The total number of ecoStmic delegatio&,>staf f members in the, Washing- 
% t£fei, D*C*, Soviet 'consulate who fly to the Soviet Union at least once 
a mouth; who havte *bdld heads, and who are undercover intelligence 
-M agepts* — ' ;/ ' . 



■■■ \ ' 

The size of each of these groups -is obviously ^feller than the forme): 
groups, in which the information about ,baldn&W*was not us£d. 

Will the percentage (the rat^*^^Am^both groups multiplied by 100), 
from which we infer the chance <^^4^g^ always change when new infor- 

mation is used? No; it is alwa^,j»bsa^X^;^at the ratio will remain the same 
although the size of .the groupsfe^l^gfe^ jifwSange in the percentage will in- 
dicate that the net\ item of inf^^^ip^ I'^&evqf^ but it is a retrospective 
indicator, since the item has ar&affi ^eeh^&en into account* We would like 
to check the relevancy of each 'a*Safcl<^l # i^iu in ad vane ft . in order ^:o decide 
whether to use it* N^gJfr 1 ^'*"' * * 

To check relevance, one has to ask oneself whether it is rOflfeonaBle* to 
assume that ,the percentage of agents out of those who have bald he^ads is 
different from the percentage of those who do not have bald heads* As there 
is no reason to assume that baldness can be regarded as a relevant item of " 
information, it should not be taken into account* 

A check, in advance, of an item like "flies *to the USSR at least once, a 
,month" should be done by asking oneself whether the percentage of agents out 
of those who fly frequently is different from the percentage of ^agents who do 
not* This time the answer will probably be positive and this item would be 
taken into account (as we did) *^ * / ^ 

Information about a person's position (high versus^low rank), travel 
abroad (travel much versus little), education (elementary school, higtj school, 
higher education) is relevant if one believes that the percentage of under- 
cover agents differs with the different Values each of these irans can tafce* 

When we conclude tha / t^taking a certain item of^ information into account 
will not change the percentage, we will regard this item as irrelevant or v * 
nondiagnostic information * If we 'believe that consideration pf a certain 
iteto will change the percentage^ we wijl consider it as,- Relevant or diagnos- 
tic information. 4 . * * 



t 



Irrelevant information £oes not change the estimate and therefore" is no > 
beneficial* However, caii it h% harmful? Sometimes it cari lessen the quality 
of the estimate* Let us assume, for example, that among the staff . members of 
the Soviet economic delegation in Washington** D*C* , in recent years there 
were only* two people who shared the following two characteristics: traveling* 
tiuite often to their homeland and being bald* Later -it turned out that' one 
was an undercover intelligencB agent* Would it be reasonable to say that 
'Yermilov's chance of being a spy is 50%, just because there were two Soviets 
similar to him in these respects and one oS them wa? a, spy? The additional . 
information (being bald) excessively reduced the size of the relevant groups..!, 
so that the total group is now made up of only two people* This' is a rather % 
small sample, an5 as you may recall, ?mall samples have serious drawbacks* * 

* t * L 

* In addition, in many cases we do not have accurate information about the' 
, sample sizes; instead, we are thinking about the relevant groups, trying to 
estimate their sizes* jft is far more difficult to think about such email 
group that are multiply specified* When we search our 'memory, we may obtain 
tjighly biased estimates* 
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' It is better, then, to ignore, in our example, the baldness information 
and rely on Information concerning economists ^lyina frequently in J^ie USSR. 
ThesS characteristics will lead to forming a large enough g'rotap that the esti- 
mate obtained from it is ^reasonably reliable. 

v In summary, we we^e'faced with the dilemma of attempting to consider 
every piece of ihformation; doing so may improve the estimate by defining a 
mor^ appropriate group, bu£, at the same time, considering all information , 
may lead us to a group so small that the estimate is unreliable. We recommend 
therefore, that every available item of information be checked for relevance. 
If jjn item seems relevant*, we would incl^d^*it in defining the groups 1 (even 
though we are, thus, decreasing t^ieix size); any irrelevant items should b<r 
disregarded, to avoid t the unnecessary reduction of (The sizes of the groups. \ 

Sometimes, however, we have jo much, information that even after disre- 
garding the irrelevant pieces, *the samples are too £mallor difficult to think 
about. rWhat should we do in such erases? Bellowing is a\$fcUcussion of such 
situations. , , 



Exceptional Problems ' 

-^uppose I leanj more about Georg^ the student, at Midwest University. 
He is p now a junior, majoring TE^electripal engineering, with'a cumulative 
grade point av&rage 3.2. He grew^upln a Small Kansas town (population 
4,100) "and wasjthe valedictorian of his high school'class. At the university 
*he is an Tavid *f an of rock jnusic ayad* frequently attends Tock concerts. What 
ar£ the chances' that George smokes dope\ 

'V ' ' " ' - 

aH the information items concerning George appear relevant. Some of 
them will increase ajid others decrease the changes that he smokft dope. 
For example, the, fact that George grew up, in a small town in Kansas may de- 
crease tffat chance; on the dtljer hand, the fa£t that he often goejs to rocfc' 
concerts may increase it* * ; ; 

, i * * 

v , ■ ■ - 

Trying to estimate the chances, we define the.grbups: 

* . ! 

The total group is male- students at itidwest University who are juniors in 
'electridal engineering with GPAs of 3,2, who grew up in a smalj. town in Kansas 
were valedictorians in high school 1 , and who now frequently attend rock * 
concerts* ^ * 

r 

The subgroup is dope smokers among the group defined above* * * ' 

\t is likely that even if we had full information on every Midwest Univer 
sity student, we would not find even one oth'er, besides George, who has . these 

same characteristics. We just coulrf not,fotm a group. 

■ * * ■ 

Such cases are .called exceptional problems because it is 'difficult — some- 
times impossible — to form a group of similar cases". 
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■ £n exceptional problem is one for which we have plenty of 
relevant information; therefore, it is hard\to find many cases 
similar to* the one discussed in order to form a group* 



. v ? : x ; 

In thHa chapter and chapter 8, we demonstrated computation of chances 
according to frequencies , yelying on the, percentage'of "similar cases in the 
appropriate grdup- The requirement for applying such an approach ds the 
. abJJ^ty |o find a large enough group* When such a group can be found, rela- 
tive frequencies determine our degree of confidence. 

Elsewhere in Jthe book we have presented exceptional problems* For ex- 
ample ^at the end of chapter 4 we asked you to assess the probability that 
Reagan will be' reelected in 1984- We assume that you have a lot of knowledge 
about fteagan* that £s relevant; you yill quickly realize that no previous 
president is similar in all respects to Reagan- Since an appropriate group N 
cannot be found, one cannot entirely Jtely on methods using frequency to arrive 
at any ^assessment' of ch£inces* 

tt * Consider, as we did in chapter 4, an intelligence officer who is assess- 
ing *tnfe chances of, war* Had she done so by relying solely on frequencies, 
*she^hould have done the following: 



1.* Analyze the current situation and check the relevancy of the avail- 
able information, 

2* - Search in the past for identical periods (times during which the 
TttHitary and political^ situation was the sameias jaow-^ J v 

3* Check the, percentage of these periods which actually led *to war* 

Such a procedure is ridiculous; past situations are rarely, if ever, 
identical in all characteristics to the present situation* The intelligence 
d^fi^er^wilL never be able to get to Step 3* 



Methods of estimating chances that rely exclusively on frequency" 
coflnts can only be used when a relatively large group of similar 
cases is available* 



t focesclses * ' 

f , * % following are questions involving chances of various events* For each 
question: \ ^ f 

( , a* , r Specify the tfctal group and subgroup having the relevant 
characteristics ( * 

b* . List an item of information that Nf^fears to be relevant (that is, 
one that ^11 alter the chances)* *• 



c« 'List one information item that J seems irrelevant, 

d. If the question seems to deal with an exceptional problem, point 
that out and elaborate, 

- ExampW t What are the chances that a.t least one time during the coming 
week when. I leave my house, I will meet friends coming to visit me? 

a* Total group: all the times that I have left my house in the last 
year,, Subgroupr all the times that^ while leaving my hou6e t I have met 
.friends cominp to visit me, during the past year* 

Jk Relevant information: the number of my friends who have told me 
they plan to visit me this coming week* 

c+ Irrelevant information: my house is" painted white* ■ 

These are the questions: What are the chjances that 
■* 

1. The bullet' I am sbout to shoot will hit the target accurately? 

L 

2* .The next person to go on trial for murder in toy state will be 
found guilty? ' 

* 

3. My child will be more than 5' 8" tall when the child is 18* years oJ,<rt 

a * 

4* Humans will make contact with intelligent- creatures' in outer space 
within tfie next- 10 years? \ , 

5* The bri'dge will collapse while we are crossing it?* 



CHAPTER 10 _ 

ESTIMATING CHANCES IK EXCEPTIONAL PROBLEMS 

k . ' 
Introduction > 

Jfe will start with several examples* 

Example 1 : Dan Is a high school senior* He Is an attractive young man, 
above average in height. He has excellent gra4es, not becaysp he is brilliant , 
but because he is bright and works hard at his studies* He is a well-rounded 
and well-liked student who plays on the tenuis team and who was elected 
treasurer of the senior class* While sociable, he has not dated as often as 
many of his peers, although he does haye a girl friend this year* For many 
years he has wanted to become a physician, and he plans to go to college as 
a premed student* 

What is Dan T s chance of being accepted into a medical school? 

Example 2 : Dick is a tall, handsome' junior in one of the best high 
schools in town. During his sophomore year, he was a good student, but re- 
cently, his grades^ and behavior have deteriorated* He often quarrels with 
his peers and spends time with a bad c»wd*< He drinks a lot of beer, and it 
is also rumored that he takes amphetamines ("speed 11 ) ♦ Several times he has 
disappeared for a few days* He is surly with his parents and refuses to tell 
them tihere he has <been. Discussing Dick*s case with the school psychologist, 
the principal^tried to estimate Dick's; chance of becoming entangled with the 
law (becoming entangled with the law will be defined here as a police file 
concerning Dick will be opened within 2 years)* 

Example 3 : Judy. -is a beautiful young woman* She takes care of herself, 
and her figure is slim and sexy* She always wears fashionable clodher and is 
frequently seen in beauty parlors, coffee houses, and clothing boutiques* 

r 

What is the chance that Judy is a fashion' model? ■ > 

* Example 4 ; Robert is a young writer and journalist teaching part-time 
in oi>e of the universities on the East coast* His students regard him as a 
sensitive, honest, and interesting person* He is now spending most of bis 
time writing his second book, which is about three young men in the Vietnam 
war* Roberts first book received enthusiastic review^ by literary critics* 
* * * 

What is the chance his second book will fail (that is, will sell fewer 
than 1,000 copies a year)? 

\ 

What is common to all these examples? Using the terminology of the 
former chapter, thesa^ are all exceptional problems with a multitude of de- 
t^^l; for each, there^re, it is hard to^find appropriate groups of similar 
cases* -It is hard to find many people whose description and history com~ 
pletejy match the person portrayed in each of ,the four t examples* For in- 
stance, It will be extremely difficult to. f iajpther books that deal with 
three young men in Vietnam and that are also The second book 'of * a young writer 
and journalist who is an Instructor at a university* \ 
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' Ttt^f defcailsd' infor?aatioit creates a'picture of living human beings, each 

- one hayitfg a '.History 'and. personality of his Q* her own« Thus it is difficult 
in each- oas£- to find '"duplicates" and orgai^ze them in a group* This problem 

" becbmes .even mq^e severe when more personal aspects enter the picture* Let 
'us 'assume ttr^t it is Dan's mother who is estimating h^s chance of be£ng ac- 
cepted t'o a toxical school* She knows "her Dan" better, having an enormous 
amount of details about him* She conceptualizes pan as a very special and 
^unique person. In addlt£9tL< Dan's mother has certain aspirations concerning 

- her son; apd it is not easy for hfer to ignore them when estimating his chances 
1 of Jbeing accepted into medical sqhool. 

With ail these problems, we cannot use the f requentistic approach . We 
cannot compute the percentage of people or items having the same character- . 
istic out of th'e relevant total group. 

What should we do with such problems? Before attempting to answer this 
question, we will' show a common approach to estimating chances when consider- 
ihg exceptional problems. Later we will discuss the possible coijfeibution of 
the f requentistic approach even to such problems, 

* 4 ' 

The Common Approach — How Do^We Usually Estimate Chances of Exceptional Problems? 

Let us review the examples presented in the beginning of this chapter: 
* , * 

You probably assigned Dan a high chance of being accepted into medical 
school on the grounds that: 

, . *v . 

* • Dan ha£ traits that are necessary to be a ddctor, 

• Dan is an ideal candidate, * % 

• ^fost doctors werfe like Dan in high school, 

And what did you think about Judy? 

• She looks and acts like a fashion model, 

• Host fashion models look like Judy, 

I 

What about Rotor t? The chances his second book will fail seem smajl 
; because: * 

• Robert iooks like a "symbol of success,"' 

• He is, a sensitive and promising young writer, 

• Robert's first book was a success. Why should the second one fail? 

Such arguments can teach us something about ouiVftay of thinking. We can 
divide tfcem into two groups: 

1. Reasoning bas^d on the similarity between a description and a proto- 
type . We find (or sometimes fail to *f indV a striking *simllaritj^ between the *' 
described case and the characteristic that we are 'attempting^ to estimate: 
Dick is acting like a typical predelinquent, Judy looks like a *faahion model 
ought to look. But Rober^,fe just not the usual "f ailure" as a writer?*. 
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2* Fregiientistic reasoning! Examples of f requentistic reasoning are 
"Most doctors t were like Dan in high school' 1 or "Most fashion models look like 
Judy/' 

We will see in a moment that such reasoning leads us to faulty conclusions* 

Similarity between a Description and a Prototype * Let us look again at 
Judy f s description (Example 3)* What are the chances that she is an Airline 
stewardess, an owner or employee of a boutique, an actress, a cosmetics salea- 
person, a television announcer, or rich and unemployed? 

j We will try now to answer these questions in an orderly way as we recom- 
mended doing in chapter 3, where we discussed the methods of counting all possi- 
bilities* Doing as we recommended there, we will write down all of Judy's, 
possible professions and organize them in a list pf exhaustive and eitelusive 
possibilities* Then we need to divide our 100% confidence among all possibili- 
ties (see chapter 4) * * c 

Doing so, we realize immediately that it is ^exaggerated ta assim, say, 70% 
for fashion model because it leaves only 30% chance to spread across all other 
occupations* The problem* here is that similarity considerations do not comply 
with toe rules concerning chance. When we assign dances to mutually ejStiu- 
sive and exhaustive events, our assignment is compensatory: The more confi- 9 
dence we assign to one possibility, the less we have available to assign to 
all the other possibilities. Our total store of confidence is a constant, 
that is, the chances must add up to 100%. But similarity does not work this 
way. There is no constant store of similarity, so our assessments of similar- 
ity need not be compensatory. Judy ( can be highly similar to an airline steward- 
ess, and highly similar to a fashion model, and highly similar to a boutique 
owner, etc* But with chances, ve are limited to 100%* So, if the chance of 
her being a stewardess is high, then the chances of her having other' occupa- 
tions must be small. 
* 

Thus, similarity between a description and a prototype is not a good 
basis for assessing chances; it is likely to mislead, 'sometimes leading to 
ridiculous conclusions- 

* 

^Frequentistic Considerations * What is wrong with applying the frequent- 
isticyapproach, namely, using the reasoning "most fashion models look like 



Judy/*' 



It is advantageous to utilize the frequent is ti^app roach, but only if it 
ig applied properly , that -i&y using correct definitions of the total group and* 
the subgroup* In Judy's, case, the total group is all young women: who reaemble 
Judy in all details mentioned* The Subgroup is the fashion mode t la out of the 
total group* Therefore) the correct f requentistic consideration should be 1 the 
percentage of fashion models out of those young women who resemble Judy * 

Compare these groups with the total group aftd the subgroup underlying 
the reasoning that most fashion models look like Judy* The total group is all 
fashion models* The subgroup is the group of young women who resemble Judy* 
Thus , the mistaken f requentistic consideration ia the percentage of ydung 
wometf resembling Judy out of all fashion models (i*e*, most fashion models 
look like Judy) * 



119. 



130 



It is easy to show that one shouXft not make inferences about one of these 
frequentistic arguments based on the other one * If it is true that most 
"fashion models look li&e Judy (the mistaken reasoning) , it is jiot necessarily 
true that most young women who look like Judy are fashion models (the correct 
reasoning)* In the same way, if it is true that most heroin addict's drank 
milk as children, it does not logically follow that most people who drank 
milk as childjpen become heroin addicts. * 



airline 
stewardesses 




boutique owners 
or employees 



Those who resemble 
Judy 



actresses 




-(•fashion 
models 



Figure 15* Diagram of the fashion model example'. 



Consider Figure .15. The large rectangle represents young women,Vho re- 
semble Judy. The smaller areas represent those who hold th^jobs Judy-might 
hold; fashion model, stewardess, actress, etc. The shaded area represents 
fashion models* Of these, most resemble Judy (shown by .cross-hatching) . But 
among all the young women who look like Judy, only about one-sixth (approxi- 
mately 17%) are fashion models. In other words, only 17% of all ycfung "women 
who look like Judy are actually fashion models. When we are asked to estimate 
the chance of Judy's being a fashion model, we are asked to estimate the per- 
centage of fashion models among th&se young women who lQrffr*J.ike her. Based on 
the information given in Figure 15, the 'correct answer/to this question should 
have been approximately 17%. / / 

The information that "most fash ion 7 models look like JUd^" is not irrele- 
vant to the question, What are the chances that Judy ds a fashion model? But 
the relationship between the &wo ia complex. One cannot Infer directly from 
the percentage of A in B,to the percentage of B in A. When using a frequent- 
istic approach, .it is essential/th^t one carefully and properly define the 
relevant groups and make sure^at the estimate is based on the ratio between 
the correct two groups. 
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When estimating' chances , we tend to rely heavily on 

• Similarity between descriptions and prototypes and 
P Mistaken f requentistic considerations. 

Instead we ought to 

• Avoid the ertors similarity considerations can induce 
by listing a mutually exclusive and exhaustive' set of 
possibilities and 

• Check whether the group and subgroup we use for fre- 
quency estimates are indeed the correct ones* 



The Desirable Approach — How to Apply Frequent is tic Considerations With 
Exceptional Problems 

Frequentistic Reasoning for a Preliminary Estimate. Although it is ofte 
difficult to find other cases similar, to an , exceptional case (and when we do 
find them, there are usually too few of than to rely on for our estimates) , ' 
we do not have to refrain, completely from using frequentistic considerations* 
Instead of relying on frequencies as the sole course of our estimate, we use 
them for a starting point* Let us take another look at Dick's case (Example 
.2), What do we know- about him? • ' 

• He is a junior in a good high school in town* 

• He was a good student last year* 

• His + academic performance has deteriorated* 

• He attends school only irregularly and has disappeared for days at a 
time* 

/ 

• He quarrels with fellow students* ■ 

4 r 

• He drinks a lot of beer* x K 

• It is said that he uses amphetamines „ 
x • He hangs out with a bad crowd* 

• He is surly and withdrawn from his parents* 

What is pick's chance df becoming entangled with the law (I.e., that a 
polite file concerning him will be opened within 2 years)? Having all this 
information about Dick, we are tempted to say that the chances are 'quite 
high', 'since, - '. ' 1 v 

• . ''This is -the fcnag6 of an early delinquent." 

"Mos£ delinquents -started doing* similar things." 
i . 
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kut these considerations reflect the very errors described in the pre- 
vious section* We should not consider tjie percentage of delinquents 0ho re- 
sembled Dick when they wejre his age (a mistaken frequentistic reasoning), but 
rather the percentage of young men like Dick who later become /delinquent 
(a correct reasoning)* This latter percentage may not seem high if we recall 
how common it is for teenagers to go through a transient rebellious period* 
Host of them do not become delinquents* 

To estimate such a percentage we would need to define a group similar 
in every respect to Dick; t|£s would be difficult if not impossible, because 
of the wealth of details w%*know about Dick* Still, how can we assess the 
chance without relyirijg* completely an intuition? * 

As an initial step , ye recommend temporarily ignoring some of the infor- 
mation we have, and concentrating on an item (or some few items) that can 
help us obtain an estimate of chance based on frequentistic considerations* 

tl ' For example, let us deal now with the first item of information about 
pick* He is a junior in a good high school in town* We can use this item 
to start to estimate Pick f s chances by estimating the percentage of juniors 
in that high school who became' entangled with the ^aw* Perhaps this percent- 
age is recorded at the school or bjfSh^police , but even if we cannot get this 
percentage, we can quite easily estimate it* The estimated percentage will be 

,the chance of a junior* enrolled in that high school becoming entangled with 
the law* Still, this is not . Dick f s chance , for we have not yet taken into ac- 
count all, the rest of the information about him* 
* i ' 

i * 

Tt^is percentage is then only a preliminary estimate of Dick f s chance of 
becoming entangled with the law* This is a preliminary rather than the final 
estimate because it, concerns only apportion of the information at our dis- 
posal* The preliminary estimate uses a frequentistic consideration * This is 
the starting point* 

Utilizing the additional information items concerning Dick, we will 
modify the preliminary estimate to get the *f inal estimate* We will return 
to this modification later* Let us now examine ways of selecting 'information 
items for establishing a preliminary estimate by using a f r^cjuent^xstic approach * 



Sej^cting Information Items fpr Preliminary Estimateg^Some Considerations 

Ted is brought to the emergency ward of the local hospital* He is 60 
years old, quite fat, and complaining of acute abdominal pains; he has a high 
temperature (102*2°), is shuddering, and reports dryness in his mouth* 

What is the chance Ted is having an appendicitis attack? 

h * * 

If the doctor examining Ted wished to substantiate his diagnosis on fre- 
quentistic considerations, hp would have to think 3bout the group of people 
arriving in the past at the emergency ward who were 60, quite fat, complaining 
of abdominal pains, with high fever, shudders, and dry mouth* Be should have 
then attempted to estimate the^f requency of people having an appendicitis 
attack among that group * ^ 
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This cannot be done; the group Is not large enough* Never rfieless, the 
physician wishes to base his diagnosis partly on frequent Is t'lc considerations* 
If he takes our recommendation, he will temporarily Ignore some information 
and will estimate the percentage of appendicitis patients out, of, say, all 
people arriving at the emergency ward complalnli^g about abdominal pain* He 
thus Uses two Information items: patients coming to the emergency ward and 
patients with abdominal pains * Or the physician cojuld think about the per- 
centage of appendicitis patients out of all tho^e having both high fever and 
abdominal pains » The doctor has to decide what Information Item lor Items) he 
will use for the preliminary estimate* How dges he do -that? 

First, his professional knowledge and experience assist him In making 
these decisions* It Is highly plausible that there are some statistics In 
the medical literature about the percentage of Appendicitis cases among Ml 
people checked In emergency wards having high fever * If such statistics are 
not currently at his disposal, he might arrive at an estimate using his pro- 
fessional experience* Perhapg he feels he personally has more Information 
concerning the percentage of appeOdlcltls cases among those brought to the 
emergency ward with abdominal pains * If this Is the case, he will start with 
that Information, 

Similarly, the school principal (Example 2) Is more familiar with the 
percentage of those wha became entangled with the law among her students, 
than the same percentage among beer drinkers* She will, therefore, probably 
.base her preliminary estimate on the information Item, high school juniors* 

Apart from the wish to starf with a reasonably accurate estimate, esti- 
mators should also be guided by their assessment of the extent to which the 
Item Cltem^i Is Care) relevant and valid * The school principal, for Instance, 
may think that the critical lte$ Is the youth's being a stuSent In her school; 
this fact, In her view, diminishes greatly the chance of his becoming a delin- 
quent* Thus, she will start with that Item* 

In contrast, a social worker who believes that amphetamine users have 
a high chance of becoming delinquents will probably start with the Item, It 
Is said that Dick takes speed* Both^the school principal and the social 
worker will eventually have to modify their preliminary estimates according 
to the other Information Items concerning Dick. 



We would expect that the two estimators will end up with similar final 
estimates, for they used the same data* Thus. we most avoid letting the selec- 
tion of the flrsir ItemCs) bias the final estimate* L 



5 



An estimator decides which and hpw many lnformatloiKj^ms will 
be used for obtaining a preliminary estimate Involving frequentlstlc 
considerations* Two criteria should guide the estimator: - 

1* A pf&limlnary estimate should be based on an Information 
Item (or items)' for which the estimator has a reasonably substantiated 
frequentlstlc estimate* , 

2* The starting ItemCs) should be most relevant and valid re- 
garding the matter under consideration* 
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From a Preliminary Estimate to a Final One , ■ 

We have reached a preliminary estimate based On a f requentlstlc approach: 
for instance , the percentage 6f those who become entangled with the law among 
all the students of a certain high school, or the percentage of appendicitis 
patients among all people who report to an emergency ward witji abdominal 
pains, How shall we proceed to consider the rest of the information? 

After determining the information that will be the basis for the prelim- 
inary estimate utilizing a f requentlstlc approach, we need to decide in which 
direction and to what extent to modify the preliminary estimate according to 
the additional information* We will use three guidelines for making these 
decisions* However, before discussing these guidelines, we ought to warn 
that they do not consist of exact mathematical formulas describing how much < 
we need raise or lower the estimate* The direction and magnitude of modifi- 
cation will be, by and large, the result of Impressions. This modification, 
therefore, can vary from one estimator to another* v 

Following are the three guidelines: 



1* Is the Information New or Redundant? When we observe Jthe Items left 
after assessing the preliminary estimate, we ought to ask ourselves whether 
they are really tiew informatidn or whether they are part of the information 
'we already used* For example, supposing we learn that Dick comes from a 
middle-class family* Does* this really single him out from the other, students 
at the high school? If most of the students com£ from middle-class families, 
then we have, in effect, already taken this information Into account ^when we 
based our initial estimate on the student population* If, similarly, it were 
' said of Ted that he was brought to the emergency .ward feeling sick,, it would 
not be new information; we 'can assume that all people who experience abdominal 
pain feel sick* «J." 



An item that does not add information beyond that already 
used for the preliminary estimate' is redundant and^ should be 
disregarded in the transition between the preliminary estimate 
and the'final estimate, v 



Hence, before deciding on modification of the preliminary estimate, we 
need to examine every information item for newness* If 'it is redundant^ (hen 

we simply ought to ignore It* ^ \ 

* / 

Sometimes information is only partially redundant* For example, while 
80% of the students at thtf high school have^middle-class families, there agg 
some very rich or very poor students* In that case, tfre information that 
Dick's family is middle class is partly redundant with the previously used 
information that Dick attends X high school* To the ^xtent that th& Item 
* adds some small amount of new information, we can use it to change our esti- 
mate , but only to a small extent* ' 
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2* Is the Information Reliable? So far, we have not doubted the truth- 
/ fulness of the Information "Items we discussed* 

Dan plans to be a*physlclan* \ 
Ted has $cute abdominal pained 
It Is said that Dlcfc*bakes"amphetamlnes* 

/ * 1 * * c * 

Such reports are not always reliable: From whom 41d w£ learn about Dan's 
career plans? ^Dld, those reporters know wi a t they wereVtalklng about? Is the 
rumor about Dick's drug use really true? . This may be a lie started Wsbmeone 
with whom Dick quarreled* / 
* * 
We cannot be absolutely sure about the truth of* Information based on Inn 
presslons, gdsslp, rumors, and so on* We cannot assign such Information as 
much weight as we would have assigned had the Item been verified* If, for 
Instance, It was Dan himself who told us tftet he Intended to be a ^doctor, we 
,tfould Jiave Increased our^prelimlnary est4jnate based on the percentage of those 
accepted Into medical school among students with excellent high school grades* 
However, to the extent that we have doubts about the -reliability of such In- 
formation* we will moderate that Increase* * . 



Check the reliability of every new Item* To*the extent that 
you doubt Its reliability, moderate Its Influence onthe prellml-i 
nary estimate. „ * j „ % 



If reliability Is Important In a transition from a preliminary estimate 
to a final one, It Is much more Important in .selecting the item on which the 
preliminary estimate will be based* The preliminary estimate has a special 
weight In &ase^slng the final Estimate and therefore It should be anchored to 
a reliable item* Before the social worker assesses a preliminary estimate 
for the percentage of those becoming entangled with the law from among all 
amphetamine users* he ougttt'to check whether Dick really uses amphetamines » 

3* Is the Item V^lld? The third galdellne concerns the validity of 
every Information Item* The question Is, Should we change the preliminary 
estimate because of the Item and to what extent? 4 



— -w, ~ - 

If the Item is valid, the chances associated with the event 
we are trying to assess will be different when the Item is true from 
when the Item is false* If the Item does not change the chances, 
the item Is invalid* . 1 



For example, we are told that Ted Is fat* Are, f at people more (pr less) 
likely to have appendicitis 'than people who are not fat> or are the chances % 
the same jTGgardless- of the person 1 s weight? If the chances do not differ as 
weight dlfferb, then we should disregard this item of Information* - If the 
chsnces do differ according to weight, the Information that Ted is fat is 
VfllAd * We will use this Information .to change our estimate* To do So, we 
need to decide whether the Information Increases or decreases the chances* 
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How much phould we c^hge"o^ir*pstimate?^ That t depends on our impressions of 
how strongly related ^£he itfem is to "trie event we. are trying to pxedict* 

* V l\ m 

Every information it£m;pfio^ld be checked according to three guidelines: 
'1* Is it new? V - ^ "*> - 

2* Is it reliable? % *\ . ^ ' 

3* Is it valid?^ * * * 

^ ^ These guidelines will help us to shift from a preliminary* estimate 
(based on frequenti*sHc ctSns^tderations) °to a final one* We capnqf offer an 
accurate procedure far perf6im£ng this transition, but the three guidelines 
^fiftild be taken into account* ' * 



To deal with exceptional problems 

1* Ghoose Qne or more .reliable and valid information items on 
which yom vill base a preliminary estimate, based on frequency* 

considerations* ' 1 

* * " # ' ^ ' \ ' " . * 

2* Check other items for newness, reliability; *a*&i validity* 

# " i 

5* Discard items that are completely re4an3ant, unreliably 
one invalid* T * v " ^ 

4* Modify jAe preliminary estimate to take lnto^account each, 
of the remainiji^items* The magnitude of , thes^ tppdif ications de- 
pends on your impression of each item's degree newness, reliabil- 
ity, and validity. V j 



Checking the Procedure 



* Much of t|je procedure f&x assessing v chances involves intuitions an^ im- 
pressions; thi^ is unavoidably when we de&l with exceptional problems* We 
try to start with, a solid bake by using frequency -considec&tipns to determine 
-th^ preliminary estimate* Still, personal impressions play, d large role in 
thfe transition from £ preliminary estimate to* a final one* Such' impressions 
can cause biase^ kuJt ijiptakesi .Therefore, we rtfeommend, that ,£he final^esti- 
m^te'be checked or rSv&etfed, usihg two different methods* 1 \ 



/^ Method A: Checking* Against Your Inbuition * * When working tftifcugh^he 
proijieSi; you engaged in^ a^lengthy process with many, calculations and con- 
siderations* Thus it'is now appropriate to askY'ddgs my, f£qa3r estimate sou^jj 
Reasonable?. We do not recommend relying splely„on- one*s intuition to ma&fi 
probability assessn[en£& for exceptional prpblems, %ut here w^ are ^r^cofimend- 
ing 6otoething slightly different;: ^ Compare your, final estimate :^t&;,the in- 
tuitions you now hol5, after worje^ng *.jttkrougfi the problem* To ,d|o s tKis^ use a 



chance wheel,; 



Let as supgjise theft aft^jfr performing the whole procedure you obtain a 
/final estimate £hat the chance of Dick's becoming entangled with the law* is 
'40%* To compare this estimate sgainst.your intuition, that is, ^o see if it 
is reasonable, ask yourself which o£ the two following bets you pjrefert 
One bet*will pay $100, if 2 years from now, DicK turns out to have a* police 
record; tha-other bet pays $10& if 2 years from now, the spinner on a "chance 
wheel lands in the shaded area when. the wheel is set at 40% shaded* (if you 
dislike the idea that you might profit from Dick's troubles, these bets could 
be written in terms of winning $10Q if, Dick did not have a police record 
versus winning $100 with ttie wheel set at 60%*) Finding yourself with a 
strong preference for one of these bets over the other suggests that, in- 
tuitively ? your final estimate seems wrong* Believing that these bets are 
approximately equally likely 4b pay off shows that your final estimate agrees 
with your ijituition* • - * 

" ■ 

* 

When you' upe this method £nd find that your estimate does not agree with 
your intuition, you should keep in mind that intuition as explored via a 
chance wheel is not necessarily a more valid guide tola good estimate than the 
starting-point-and-adjustment procedure you are , checking* Just*the opposite 
maybe trueJ Particularly in cases with many items of information, it could 
happen that your, global intuitive feelings are^biased or that you are unable, 
intuitively, to make sense out of so many pieces of information at once, 
whereas the earlier procedure, during which you systematically sorted every ( 
item for newness, reliability, and validity and carefully considered the im- 
pact o£ every item in turn, would produce, , in the final estimate, a better 
reflection of your well-reasoned beliefs* discrepancies that occur using 
Method A signal that something is wrong, but the discrepancy itself does not 
pinpoint the locus of the problem* You must then refafcw all^the steps you 

have taken to* see where the problem might lie* 

1 " * * 

Checking your estimate agaihst'your ihtuition can be helpful in avoiding , 
situations in which a lot of little carelessnesses or biases build up to a I 
nonsensical final estimate* Like the first checking method u&ed for the 
estimation *W quantities (chapter 5), this is a way of standing bsck from a 
final statement- of chances to say, "Can I really believe that?" 

Metrod B: Us in& Another Starting Points * Just as Method A is parallel 
to the preliminary control used for estimating quantities* (see chapter 5), so 
Method B is parallel to the detailed control* * 

^SometimSk there are two different Items (or sets of items), either &f 
which could provided solid initial estimate based on frequency considerations 
When thi& is true, we can carry out the whole procedure twice, once with each 
of the two preliminary estimates » 

1 For Dick's case, we will first start with ,the frequentistic estimate of 
the school ^principal, namely, the percentage of those becoming entangled with 
the law out of her school?* s* students, and modify this percentage later accord" 
ing to the additional information st our disposal* Setting that aside; we ■ 
•will start anew with the percentage of those becoming' entgngled with the law 
among amphetamine users (if Dick is one), aryi modify this preliminary estiajate 
to take into* account thj| #£her information,^ If we obtain two very different 
final estimates, *it is reasonable to assume we h&ve made mistskes in one or ' 
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both procedures. But if the two final estimates are approximately .equal we 
feel a greater assurance that we have not made any big mistakes, 4 l 

In such a way, we also control our natural inclinptEwL to overrate the 
'items on which the preliminary estimate is based, and to underrate the addi- 
tional items* We tei\d to anchor the procedure, to the (preliminary estimate 
and later change this ^estimate according to the other fn£ormftioti items less 
than we should. For instance, if we start with a high preliminary estittate 
(the percentage -of those becoming entangled with t?he law among amphetamine 
.users), we will probably end with a higher estimated chance concerning Dick 
than a final estimate based on a low preliminary estimate (the peAentage-of 
those becoming entangled with the law among all ttuat high school's^students) , 

The fallacy of anchoring is especially severe because all of us tend to 
begin with a preliminary estimate that is influenced by our values,. For ix-, 
ample, the school principal hopes that Dick's chance bf becking ^delinquent 
is low and therefore starts with the percentage of those becoming entangled 
with the law out of her school's students. Differences between final esti- 
mates may be the result of strong 'anchoring on different starting points* By 
carrying out the whole procedure several times, starting at different points, 
we will be able tp check whether there are large discrepancies between fi^l 
estimates. Such discrepancies are indicative of one or more mistakes~in the 
procedure. 

Exercises 4 4 

^1* Read* the following pairs of sentences* Decide whether 4ach sentence 
is true or false. 



a. 


(1) 


Most 


men are more than 20 years old* ^ 




(2) 


Most 


of 'those who are more than 20*years old are men* 


b. 


(1) 


Most 


soldiers on regular military service are men* 




(2) 


Most 


men are soldiers on regular military service* 


c. 


<1> 


Most 


cars are private property* 




(2) 


Most 


private .property is'c&rs* * ^ 


d. 


(1) 


Most 


fish are not mammals* *j 




C2) 


Most 


animals that are not mammals are fish. 


e . 


(1) 


Most 


pilots also have driving licenses*. 




(2) 


Most* of those who have driving licenses are pilots* 
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2* Choose two*, of the four examples from the beginning of this chapter, 
Please n^ake a listjbf all the information items contained in eac^ example* 

a* Choose one information item that you think, is suitably as a 
*basis of a preliminary estimate* Explain your choice of that particular 
* item* ' - ' ^ 

^* b* For each, one of th$ other items, evaluate and' explain to what 

* ^extent it Is: t 

^ ■ 
\ • New, 

*". • Reliable, and " i 

' * s '• Valid. 

■ ' - * \- ' 

j v c. For each one of these items, would you change the preliminary 

estimate in view of the new item, and in what direction? 
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CHAPTER 11 



TWO DEMONSTRATIONS 



This final chapter presents two examples that are worked out in some 
detail, using the starting-point -and-adjustment method presented in chapter 
,10* In the first example, we have a small amount of quite specific Infor- 
mation that we use to form grojups and subgroups* We arrive at the answer to 
our question by estimating the frequencies of these subgroup^* In contrast, 
the second. example provides an abundance of rather vague information* It is 
an exceptional problem for which it is difficult or impossible to estimate 
the frequencies for the relevant subgroups* Thus, in the second .example we 
majce our assessment of the chances more informally* 



The Basketball Player and the Bank President 

Fred is a research assistant employed by a survey research institute* *< 
One day he was preparing. for the computer some questionnaires filled out by 
a random sample of adult men in 'Amer ica* The questionnaires dealt with the 
professions and occupations of these men* * ^ .■ 

* 

When working on one of the questionnaires, Fred saw that the respondent's* 
occupation was marked carelessly. .This Is part of the questionnaire; 



Respondent M23 

Sex (l) Male 
2 Female 

Height 1 under 5 f 

2 5* to 5*5" , 

3 5'6" td S'li** 

4 6/ to 6*5" 
(|) over 6* 5" 



Occupation 



16 
17 
18 

21 

22 



baker 

banlo employee 
bank president 
basketball player (NBA) 
beautician 



Fred could not decide whether the respondent's occupation was bank president 
or basketball player* Then he noticed the respondent's height, over 6 f 5 fl * 
He thought^, I cannot be sure, but I think there is a far greater chance this 
guy is a ba^kStball player than a bank president* 



The Common Approach 

Moat people would have estimated the chances the way Fred did* When 
.asked to divide 100% chance between the two possibilities, they would have 
answered something like: 



Banty president 5% 
Baslcetball player 95% 
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The reasons for such answers would have been: Basketball players are taller 
than bank presidents, or he Is tall like a basketball player* Let us now 
{leal with this problem by using the techniques described la the last two 
chaptyers* ' t - 



The Desirable Approach * , - — 

A Frequents ttc Preliminary Estimate * Let us suppose that for some 
reason the questionnaire under consideration lacks the Information about 
height* In' such a case we have to rely solely on the knowledge that the 
respondent Is a male In America who is either a basketball player or a bank 
president* Me will use frequency considerations to arrive at the chances for 
each occupation* 

Basketball Players : A quick call to the sports desk of our local news- 
paper reveals that there are 23 National Basketball Association (NBA) teams, 
each of whom carries a roster of 12 players, for a total of 276 NBA players 
in the United States* 

Bank Presidents: We find an almanac saying that as of 1980 , there were 
about 15,000 commercial badks in the United States* Assuming that each bahk 
has just one president, we can use that' number as an estimate of £he number 
of bank presidents* ^ / 

Chances : Thus our respondent could be any o^? qf 15,276 people, of whom 
15,000, or 98%, are bank presidents, while 276, .or 2%, are basketball players* 
Our preliminary estimate thus is 

Bank president 98% 
Basketball player 2% 

Modifying .tfee Estimate with Additional Information . Clearly, the infor- 
mation that the respondent is over 6*5" is valid — it is safe to assume that 
basketball players, as a group, are taller than bank presidents. And it is 
certainly new Information* Let us also assume It is reliable, that the inter- 
viewer very rarely makes & mistake in filling out the questionnaire* So the 
respondent's height is a good piece of Information we can use to change our 
evaluation of the chances. How cap we do that? We will use that Information 
to reduce the size of the original group, from the group of all bank presi- 
dents and basketball players who are over 6*5" (see chapter 9)* With the help 
of the frequency table below, we will now assess the size and composition of 
this new reduced group* 

What proportion of basketball players are over 6 f 5 n ? Many of them* 
Let us estimate that 60% pf all basketball players are 6*6" tall or greater* 
that is 60% of 276 players, or 166 (see Table 2,' second column)* 

"What? proportion of bank preisldentk are over e^S" in height? This Is a 
rare height for males In America* Perhaps It is a IjLttle mor£ common, among 
successful and prosperous males like ba^k presidents* Perhaps 2% of all bank 
presidents are over 6 ? 5" tall* That is 1 in every 50; does that seem reason-" 
able? So.how many tall bank presidents \are there? Two percent of 15,000 is 
300 tall bank presidents (see Table 2, first column)* 

\ 
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We can summarize these estimates in Table 2* 

[ Table 2 

* 

Frequency Table 















. Bank 
/ presidents 


Basketball 
players 


Total 


6*5" or shorter 




14,700 


' 110 


. 14,810 


Over 6 '5" 




300 


166 






Total 


4 


15,000 " 


■ 276. 


15,276 





- < ... x 

Thus we have reduced the total group of 15*276 to a s mal ler group of 
466 (300 * 166) which more closely matches all the information we have* Thos 
466 men comprise the group of males in America who are over 6'5" ta£L and 
are either bank presidents or basketball players* 

r 

Now what are the chances that the questionnaire respondent is a bank 
president? Since 300 of those 466 men are bank presidents/ the percentage is 
300/466 x 100 = 64%* The rest, 36%, are basketball players* Our revised es- 
timate, based on all our information is; 

Bank president 64% 
Basketball player 36% 

Checking the Estimate * As recommended in the last chapter, we will 
check our estimate* 

Method A requires us to choose between~the following two bets; 

Bet 1 ; Win $100 i^the respondent is a basketball player; otherwise 
win nothing* 

Bet 2: Win $100 if, using a chance wheel set at 36% in the shaded area, 
the spinner stops in the shaded area* , 

Here we realize that our intuitions favor Bet 1 by. a large margin* We 
feel that it is very likely, far more than 36% chance, that the respondent is 
a basketball player (we had, earlier estimated the chances as 95%)* Bet 1 
seems much better than Bet 2; this shows that something ;fjs wrong, 

* 

Let us then review our procedure for possible errors* The starting esti 
mates c gftre f torn an almanac and the sports desk of a newspaper, so they are 
likely to be pretty close* They also accord with our intuitions* Jgo this 
does' not seem to ^e the source of the problem* » 
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Could our u$e of the height information be faulty? Yes, we did use rather 
informal and rough estimates of the proportions of, bank presidents and basket- 
ball players who are over 6*5" tall* How far off mightrfre be? Up3n reconsid- 
eration, we, find it not implausible that only 1% of bank preSid^hts (i*e*, ' 
150 of them) are that tall, And perhaps as many as two-thirds (67%) of all 
basketball players are that tall* Using these new estimates , we revise the 
frequency table to look like Table 3 * i 



Table 3 
Revised Frequency Table 



Bank , Basketball 
pres idents players Total 



6*5" or shorter 14,850 92 14,942 

Over 6*5" 



* 150 184. . 334 



r- 



Total j 15,000 276 * 15,276 



Now our estimate for the chances that the respondent is a basketball player ( 
is 184/334 x 100 « 55%* This number is larger tharuour previous estimate of 
36%, but it is still much lower than our intuitive estimate of 95%* Same 
fooling around with height percentages will reveal that we will get an Esti- 
mate as high as 95% that the respondent iWa basketball player only if we use 
extreme estimates like 80% of all basketball players are over 6'5" and only 
12 out; of the 15 t 000.b&ok presidents are over 6*5", Both these last estimate^ 
are too extreme* We just cannot believe them* We are t therefore, convinced 
that our first quick and intuitive estimate (95%) was much too high* 

« We already know from chapter 10 that intuition Is not an infallible 
guide* Let us reexamine our intuitive estimate and s&e why our intuitions 
mislead us* Our intuitive estimate was based on similarity t A very tall 
person #is similar to a basketball played but not similar to a bank presidgrft* 
But as discussed in Chapter 10, similarity considerations can lead us affray* 
What our intuitive "thinking omitted is revealed by oar step^by-step proce- 
dures; Although very tall bank presidents are relatively unlikely, there are 
so many more bank presidents than basketball players that even th^proportion- 
1 ately few tall ones can outnumber the tall basketball players* When we re- 
alize this, , we understand why in this ?ase it was our faulty intuition which 
led, us astray* \ ' 

s 

Once we understand that the discrepancy revealed by checking our esti- 
mate using Matted A comes from our faulty intuition and not, from errors in 
our step-by-step procedutep, we can more caliiLy review those procedures once 
again* > We decide that while we are still' not certain of tKe height estimates 
of 2% ajtd 60% for the two occupations! they do appear to be pretty £H>se; 
closer than the 1% anjd 67Z, estimates we later tried* So after all our 



checking (more checking Chan this problem nay deserve, but not more checking 
than we ought to devote tp serioJis life decisions) , we endkup feeling comfort* 
able in saying, "The chance that our respondent is a basketball plkyer is 36%*" 

Method B for checking the estimate requires us to choose some oxher in- 
formation to use as a starting point* This method does not really apply to 
Jthis simplified example, Oyr original question was "What & re the chances the 
respondent is a bank president versus a basketball player?" The question it- 
self provided the basis for our original estimated Gender and height, our 
only additional items of information, could not have been used alone to pro- 
vide a starting estimate* So here we cannot use Method B, 

Marriage and Divorce 

Art: Did you hear Anne and Joe are getting* marrifed next week? 
* 

Bill: Yeah, I know Ann£, but who's Joe? 

Art: Oh, you know, he's that studious guy who lives down the hall; 
he's a junior majoring B in computer science* 

* 

Cathy: You think Anne'll stay in college? 

* 

Doris: Sure, for one more year, anyway* Both their parents have 
agreed- to support them until Joe graduates* 1 

* 

Bill: And if they get hard up for money, they can sell that car Anne's 
parents gave her last year* 

Cathy: I bet that marriage won't last a year* 

Bill: Why? 

Cathy: Anne's such a friendly, sociable, gregarious type, while J^e s 
a loner — he l£ft Sue's party last Saturday night by 9:30; They'll never get 
along* 

Doris: Well, I heard they're getting married because Anne's pregnant* 

* - 

Bill: Who told you that? 

Doris: I heard two guys joking about it at Sue's party* I don't know 
who they were; I never saw them before* 

Cathy: Juicy gossip, if true* Anybody else hear *that? (Pause) Anyhow, 
that marriage will never lest; he r s only 20 and stfe just burned 19 ♦ 

Doris:, Early marriages never work* Even if they make it through the 
first, year, the chances are. they'll be divorced before they can celebrate their 
fifth anniversary* r 
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Art: ,Don f t be^ so gloomy* They f re nice, bright people* Joe'll get a 
good job* They 1 11 make it* 

Doris: We*ll 'see* 

* 

From the information giVen above, jte will use the methods of chapter 10 
to assess the probability that Joe and Anne vill still be married 5 years 

after their marriage* 

■m. 

A Brequentistic Preliminary Estimate * First, we have to choose something 
to use for our starting point* *5&tting aside all the details about Anne and 
Joe, how many America!! marriages today last for 5 years? Searching the library 
for marriag\ statistics, we founds re levant data oftly.for the years 1960-1966* 
For ^hose years, 93% of all marriages lasted 5 years or more* Can we use 
these statistics? Only if we believe there^has been no real change since * 
then* But we are pretty sure there has been a change since the early 1960s* 
We have often read that divorces are more frequent today* In 1978, America 
there were 2,282,000 marriages and 1,130,000 divorces* That is a lot ^of 
divorces; for every 1,000 married couples at the start of 197JB, there w^jre 22 
divorces during that one year alone* Of course, not all those divorces in- 
volved couples who had been married less than 5 years* Still, thinking hard 
about all we Unow about divorce in America today, we believe that the statis- 
tics, 93% of all marriages last for 5 years or more, while true in the 1960s, 
■ is^ no longer true. After some consideration, we arrive at a lower estimate: 
We* believe that, of all American marriages today, about 75% will' last for 5 
years or more - 

Should we use this estimate of 75% as our starting point? It is cer- 
tainly relevant to the problem atjiand, it is simple and direct,' and it pro- 
vides us a natural starting point we could adjust to take other information 
into account* But the trouble with this as a starting point is that it is 
based more on our intuitions than on any actual frequencies* Still, it is 
probably the best we can do* Whatever problems we encountered in arriving 
at the 75% estimate would still be with us were we to use some more specific 
fact (e*g*, 5-year survival of marriages of two college students) for our 
starting point. So, with less confidence than, we would prefer, we will use 
"75% of all U*5. marriages today survive 5 years o* more, 1 ' to start with* 

Modifying the Estimate with Additional Information * Next we must con- 
sider the newness, validity, and reliability of each item of information* 

1* Anne is 19; Joe is 20* This strikes us as new t and reliable infor- 
mation* Furthermore, we think it "is valid: We believe that divorce Is more" 
likely Among those who marry when young* We definitely want to use this 
information* 

2* Anne is friendly, sociable, gregarious; Joe is a studious loner* 
Again, jthis seems to be new and reliable* Is It valid? Cathy thought so; 
she seems to believe that people vho are dissimilar in outgo ingness. are more * 
* likely to get divorced than are similar people* But one could argue that 
Anne and Joe will complement each other and jget along fine'* After some thought, 
we tend to believe, that personality information like this is not a valid *p re- 
dlctor of marital success* We are going to disregard this Information* 
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3* Anne is a freshman or sophomore in college; Joe is a junior majoring 
in computer science* What are we really learning here? They are college' 
students* Are college-student marriages more stable than 19- and 20-year-old 
nonstudent marriages? We find we can argue this both ways: intelligent and 
educated enough to cope with the crises that may arise, but also able to , *, 
recognise when a marriage goes sour, and get out quickly* So we think there 
is no validity to the college-stydent information* How about Joe f s major, 
computer science? That is consistent with the knowledge that Joe is a studi- 
. ous lotfer, but .we already decided to disregard personality information* 
Finally, there is £ hint here, as Art pofiits out, that Joe's major may pre- 
pare him for a good job after graduation* This hint we wil^ combine -with 
two more items of information: 

4* Their parents will support them until Joe graduates* 
5* Anne owns a car* 

Separately these items may seem irrelevant, but together they paint a 
^icture*of adequate (or better) financial support for the marriage* This 
derived piece of information is new, seems reasonably reliable, and valid* 
Young people who must scrape for money seem to us more likely to get divorced 
than other people* Notice here that we combined ttje items, computer science 
major, Joe will get a good job, parents 1 support, and Anne f s car into a single 
item, adequate financial support, in order to avoid redundancy* 

6* Anne may be pregnant* If true, we might regard this item as valid; 
a "shot-gun" marriage seems doomed* But We reject this bit of gossip as un- 
substantiated and^ 'unreliable* 

7* They are nice, bright people* But everybody thinks their friends are 
nice, and in our discussion of item 3 we already assumed they were intelligent* 
So there is no new information here* 

What are we left with? Young people with adequate financial support* 
How can we use this information to alter our estimate? Perhaps we could use 
this information in a formal way, as we did' for the bank president/basketball 
^ player eSample* We would create Table 4* - 

f . . ■ 

\ * Table 4 

1 " = * 

' Frequency Table 

Still married Divorced 
" after 5 years within 5 years Total 



Young with , 
adequate finances 

All other couples 

Total 
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If we could find or estimate the frequencies for the crucial subgroups, shown 
boxed in the frequency table above, we could use them to assess the probability 
^ we want* But our knowledge and our almanacs now fail us* In t^e previous ex- 
ample, we could learn from an almanac that therfc are about 15,000 bank presi- 
dents, and our knowledge and experience with the heights of men supplied us 
with an estimate that about 2% of them were 6 f 5" or taller* Here, however, 
we do not know how many marriages last 5 years, and our intuitions are silent 
on the percentage of such long-lasting marriages that involve two people who, 
when they got married, were young and with adequate financial support* * 

Instead, we will consider 'each fact separately* First, they are young* 
What are our belief s^about the effect of youth on the lastingness of marriage? 
We believe that people are more likely to get divorced when they marry young* 
Earlier, we estimated that one of every four marriages ends in divorce within 
5 years* But if the partners are both young, it seems to us that one of every 
* three will be divorced in 5 years* That translates into a change from our 
starting point of 75% to a new estimate of 67% that the marriage will last 5 
years* Notice that even though we were unable to guess the total number of 
marriages in various^subgroups, so that we could not fill in the frequency 
table, we were able to estimate ^ relevant relative frequency , one of every 
three (se6 chapter 9)* We are approaching this problem a bit differently 
from the way we approached the bank president/basketball player example to 
make best use of what little information our intuition provides* 

Next we must take^afc^ount of our last fact: adequate financial support. 
This is a positive factor; it should increase the chances that the marriage 
will last* But how much should we raise our last estimate of 67%? This time 
our knowledge is even weaker* We do not seem to be able to estimate even 
relative frequencies* So we turn now to a different kiii'd of reasoning to help 
4 us* It seems to us that the a%e factor is a stronger piece of evidence (to 
lower our estimate) than is the financial factor (to raise our estimate) * So 
we should raise our estimate, but not as far as we just lowered it. fre lowered 
it from 75% to 67%; now let us raise it just a little, to take into account 
this new but weaker information* We decide to raise it to about 70% ■ 

We. have now taken 3$ito account all the information that passed through 
our triple screen of new, yalid, and reliable* Our final estimate is that 
the chance that this marriage will last for 5 years is around fft%+ t 

Checking our Estimate , Using Method A, we compare two 'bets: 

1* We will win $100 a in 5 years if Anne and Joe^are still married* 

4 

2, We will win $100 in 5 years if a chance-wheel spinner lands in the 
70% area* 

Wh$n we think about these bets, we recognize that we feeT r very little conr 
fidence in the #*ecision of our estimate* An estimate of 60% &r 80% does not 
seem totally unreasonable. Still, our analysis convinces us that^we disagree 
with Doris; the marriage seems niore likely to last than to fail* 
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Next, let us* briefly sketch an approach to Method B, checking by using r 
a new starting point* We will take as our starting point the age farftor, be- 
cause we fojjnd we had strong feelings about this* But we will reword the prob- 
lem to start with as low an estimate as possible, in contrast with our origi- 
nal analysis, which started with a rather high estimate of 75%* 

Starting Point : Let us estimate the quantity; 'what proportion of mar- 
riages between two people;, j*ho are both* younger, than 21* will last, without 
divorce, until the d&srtfT of one partner? *We do not really know the answer 
to this questions but we feel that, eventually, most of these people will get 
divorced* Indeed, we believe that, of every 100 such marriages, 75 will end 
±h divorce, while only 25 will endure until the death of one partner* We are 
not too confident in our estimate, but we will use it as our starting point: 
25% of marriages among the young 'last * 

Adjustment I t We must now adjust our estimate to reflect the fact that 
our real interest lies in marriages that endtire for 5 years, not forever* 
Of our hypothetical 100 marriages, 25 never got divorced and 75 did* When did 
those 75 get divorced — early (within the first 5 years) or late? Again we 
feel quite uncertain of our estimate, but roughly, we estimate that 35 got * 
divorced during the first 5 years and 40 got divorced later* So at the end 
of 5 years, 65 are still married, the 25 Who will never divorce and the 40 
who' will get divorced later* Our new estimate is 65%* , 

Adjustment 2 : But our couple's ages are not 15 and 16, they 1 are near 
the top of the age range, 19 and 20* That is a positive sign; we use it to 
increase the chances from 65% to 70%* 

Adjustment 3 : The financial factor is also, in oux minds, positive* 
We use it to raise our estimate again, from 70% to 75%* f 



Since we have now used all the valid, new, reliable information, this 
is our final estimate : 75%* This does not differ much froin our original 
estimate of 70%* We realize that our recalculations were even more subjective 
and open to error than was our original analysis* We conclude that our esti- 
mate is only approximate* Still, these analyses have made us reasonably 
confidenf^that Anne and Joe's chances are faurly high, perhaps somewhere in 
the range 60% to 85%* J 



Final Comment 



While the two problems discussed in this chapter may seem trivial, we 
believe they capture some essential aspects, of the serious, important problems 
inyolving uncertainty that one eacounters: 

l\ Research or consultations with experts will often reveal highly 
relevant estimates* * . 

2* One's own problem (particularly exceptional pjcoblems) will have spe- 
cial features for which no solid facts are available* One inevitably ends up 
relying to some. extent on subjective beliefs* 



139 149 



3* A careful analysis will enable one to merg^ the "hard facts" with 
the °soft impressions 1 ' to yield a better estimate than would reliance on 
either the facts alone 'or -unaided intuition* 

" * 

"4* We should choose a structure for pur analysis that is most compatible 
with the form of our facts and beliefs* / 



Exercises 



1. Reread the basketball player /banK^resident analyst?^ Is there any 
estimate youfeel (is wrong? If so, make a new* estimate (or more, as needed) 
and completfeche calculations with your new estimates* Is bank president still 
the iaore likely answer? ~* * x 

*' [ 

2* Repeat the ^en tire marriage /^divorce example, making your'own judgments 4 
Vlibout starting point, newness, validity, reliability, and adjustments* Would 
you rather bet on divorce or no divorce after 5 years? 

3* ChoosMa problem which interests you and for which you feel you have 
some information* Analyze it using a starting point a$d appropriate modifi- 
cations* Check it afterward* * * 
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.* ADDITIONAL .TOPICS' FOR STUDY ** 
1* fbychb logical researcl^jon thinking undet* uncertainty 



* . .IJe^sc^iptive and normative questions (Hfcw do. people tliltik? , Jta* fc^py 
thin\ co^efefly,?) * . "\ ' * ■ \.--. ■ 4 -v'y v ~ijf*>; ' 

b*. koxmativ^ mQdelV ttt .thinking %e^earcii (examples): ' Conservatism ' 
in children .{Fiaget), logical ^feiiiking (Ifasan)^ pjfobablliVt^Lc^ thinking' \ 



'? v. 



c„ Main Results in- Mobabilistld tftipking research 

* Errors of judgment- are systematica not random - . " >~ 
" . Shared jby, experts an<f laypepple alike ; ^ / 

* ISjrroneous intuitions resemble visual illusions; they remain com- 
h . ^ pelling even ^iep one is fully s aware of their nature _ 

cL Conclusions and recommendations 

' jKnow how good or bad you are and when " A- \ 

*. JEtoldei: circumstances where there is\a chanc^ro^ failure, use cor- 
h f f : ;y ;,^T^tiv^ procedures f ' -^"^ 



VjT^!' V'^/ v; ; T?Jfy *to^ aware of the thinking strategies you use 

';' ' : ''*,'^ ^*jfecoj(tt^ii«* c'omfortabte with the numbers of probability 
* v '' :/ - ' ^a^i ^)ef ittlt^ons and comparisons 



■#'V^ba$ifetiee 
V>- "Cbatices 



^C^^,:^bM;-^" r few NT^wtai' exab'ples 



of r each fotrn 



■ - v , , o> ifa&stpraing'.one measure i t<y another 
v. ^ 4y'< C^ncitfeions' and reconimendatioti? 

■^/•V^;'v' : -;Vi ■' ■', .-. \ ' 

3*f; ' ^kt^^retWo^ !of ^rbbability : 



V- 



- -if', - j-* 



' ^a;.. ■ WSat ^ a gic(d -iritetpretatlon? Tfrcee criteria 



vi 1 J / Y , ". 



^i^/^W il^ic ji^terpr^^ 4 , . 



,r ( V ** - 



rT*:VMfJiiMBtfct6?*wttH .the indifference, principle 

.: -IV < i ii t > ' * 
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c* The logical Interpretation (garnap)' 

* Definition 

* - 

* Difficulties; no necessary relation between the probable v 
3nd the frequent 

d* " Th^f requentlstlc interpretation (Relche'nbach) 

'# Definition , 

* Difficult les^lth unique events 

e. fhe/subject^vistic Interpretation (de Flnettl) 

* ' Definition ^ 

* ^l^lcultles with coherence 

f ♦ Psychological interpretation; How do people interpret probability? 



g* m Conclusions and recommendations 



4 r What- do we mean when v 

a. The difference l?etwe 




hat a probability Is "good^jt 



I^a clairvoyant and a forecaster (predicts with 
certainty , always right versus Staking probability assessments* not' alfrays* nij|tit) , 



on (l*e , t a slngl 



b* The difference between a good pxedl 
and a good forecaster (l*e,, $ set' of assessments 

c , Aspects of goodness 

* * Normative goodness; following the rules of probability 

* Substantive goodness; degrees of knowledge 

• Calibration; matching Svent frequencies 

d/ Measuring goodneste; pr9per scoring rules 



e* Conclusions and recqwmendatlons 1 
Calibration and overcopfldenqe 
a* Calibration 

*• ' What is It? "* - ' , r 
How Is It measured? 




• 4 When should we expect good calibration and wfren should ve j no£ 
, expect It? . * 

' " * w * 

I . » - ^ _ * * * r 

• Whjf^Jre^IEsimportant to test for' calibration 

• " i 
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■b. 'Research cw^Slibratioti 

/ - / Main Result: overconfidence 
• Debiasing techniques 



c Conclusions and recommendations 
Hindsight 

a. Foresight versus hindsight 

*. 

• Definitions 

• Is there a normative difference? 

* 

b. Wfeea 4o we do each? 

c* Psychological literature £n hindsight, 

w * 

• Main rsstilts 

• Dei>lasing' : efforM * 

* ■ 
d* Conclusions and recommendatipns 

* * 

The percept ion of correlation 

^. Judgment bf correlation; for what? 

b* Normative definitions bf correlation 

-* ^ / 

• Presentation of a few definitions 

• Common aspects of all* definitions- v r , 

c*-" Psychological /research on the perception of correlation 

■ ■ J- ■ - ■ '■. ; ■ 

• What relevant information do we neglect?- 

What Irrelevant information >do. we take account of? 

Corrective ptoc6dures. v - * * 

■;'.."■•"> " " < ■ ^ ' - . , ■ - ' 

• ' Define the' variables nnd values fnvolved* 

• Prepare the 2 fcafcle / ■ > v 

• „ Estimate the relevant -conditional probabilities 

• Check forr pbssible biases - " « ; % ' " " 

e^ 1 Conclusions and recQmmeilSations - - \ <* ,\ ; 
Statistics j " - - 

a r . What is trfie field of statistics? 
b* Why use -statistics? " ' * 

c. Descriptive versus inferential statistics 
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,d. The normative basis for inferential statistics 

e* How the concepts taught in this book.relate to formal statistical 
techniques v - 

f ♦ How people are fooled with statistics 

g. Conclusions and recommendations 1 

9* -Miscellaneous additions to the present chapters 

a* The gambler's fallacy ^ 

b* Bay^s 1 theorem * • ' 

c. Examples from newspapers: Bear Abby* etc* 

d* Extended example; the use of mammography to diagnose Breast cancer 
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